[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 08:18:51.328862 29194 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.130.190:35317
I20240502 08:18:51.330642 29194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 08:18:51.332203 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:51.344588 29199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.345099 29200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.345708 29202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:51.346411 29194 server_base.cc:1034] running on GCE node
I20240502 08:18:51.347326 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:51.347512 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:51.347604 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637931347580 us; error 0 us; skew 500 ppm
I20240502 08:18:51.347962 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:51.350940 29194 webserver.cc:460] Webserver started at http://127.28.130.190:41159/ using document root <none> and password file <none>
I20240502 08:18:51.351784 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:51.351898 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:51.352278 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:51.355724 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/master-0-root/instance:
uuid: "063eefa22bfc407b871e16366ab9c0c0"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.361735 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240502 08:18:51.365101 29207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.366685 29194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 08:18:51.366861 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/master-0-root
uuid: "063eefa22bfc407b871e16366ab9c0c0"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.367056 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:51.382635 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:18:51.383448 29194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 08:18:51.383721 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:51.402750 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.190:35317
I20240502 08:18:51.402771 29258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.190:35317 every 8 connection(s)
I20240502 08:18:51.407465 29259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.421169 29259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: Bootstrap starting.
I20240502 08:18:51.425136 29259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.426291 29259 log.cc:824] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: Log is configured to *not* fsync() on all Append() calls
I20240502 08:18:51.429075 29259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: No bootstrap required, opened a new log
I20240502 08:18:51.436451 29259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER }
I20240502 08:18:51.436800 29259 raft_consensus.cc:374] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:51.436893 29259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063eefa22bfc407b871e16366ab9c0c0, State: Initialized, Role: FOLLOWER
I20240502 08:18:51.437649 29259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER }
I20240502 08:18:51.437848 29259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:18:51.437956 29259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:18:51.438094 29259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:51.440193 29259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER }
I20240502 08:18:51.440701 29259 leader_election.cc:302] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 063eefa22bfc407b871e16366ab9c0c0; no voters:
I20240502 08:18:51.441414 29259 leader_election.cc:288] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 08:18:51.441589 29262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:51.442234 29262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 1 LEADER]: Becoming Leader. State: Replica: 063eefa22bfc407b871e16366ab9c0c0, State: Running, Role: LEADER
I20240502 08:18:51.442886 29262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER }
I20240502 08:18:51.443624 29259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 08:18:51.445891 29263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "063eefa22bfc407b871e16366ab9c0c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER } }
I20240502 08:18:51.445901 29264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 063eefa22bfc407b871e16366ab9c0c0. Latest consensus state: current_term: 1 leader_uuid: "063eefa22bfc407b871e16366ab9c0c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063eefa22bfc407b871e16366ab9c0c0" member_type: VOTER } }
I20240502 08:18:51.446249 29263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [sys.catalog]: This master's current role is: LEADER
I20240502 08:18:51.446252 29264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [sys.catalog]: This master's current role is: LEADER
I20240502 08:18:51.447960 29269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 08:18:51.453744 29269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 08:18:51.454407 29194 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 08:18:51.463194 29269 catalog_manager.cc:1347] Generated new cluster ID: 4f1dcddc11b94aa6b6dbcac53f98a7d4
I20240502 08:18:51.463323 29269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 08:18:51.477192 29269 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 08:18:51.478621 29269 catalog_manager.cc:1504] Loading token signing keys...
I20240502 08:18:51.493708 29269 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: Generated new TSK 0
I20240502 08:18:51.495038 29269 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 08:18:51.519992 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:51.525101 29282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.525499 29281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.526196 29284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:51.527396 29194 server_base.cc:1034] running on GCE node
I20240502 08:18:51.527740 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:51.527829 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:51.527902 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637931527873 us; error 0 us; skew 500 ppm
I20240502 08:18:51.528108 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:51.529724 29194 webserver.cc:460] Webserver started at http://127.28.130.129:45949/ using document root <none> and password file <none>
I20240502 08:18:51.529985 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:51.530074 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:51.530231 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:51.530943 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-0-root/instance:
uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.533993 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20240502 08:18:51.536020 29290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.536423 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:18:51.536548 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.536681 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:51.563243 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:18:51.563977 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:51.564978 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:18:51.566625 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:18:51.566756 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.566888 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:18:51.566974 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.591960 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.129:33193
I20240502 08:18:51.591979 29352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.129:33193 every 8 connection(s)
I20240502 08:18:51.594154 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:51.604570 29355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.610446 29358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.614668 29360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:51.619484 29194 server_base.cc:1034] running on GCE node
I20240502 08:18:51.619958 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:51.620054 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:51.620138 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637931620096 us; error 0 us; skew 500 ppm
I20240502 08:18:51.620323 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:51.622501 29194 webserver.cc:460] Webserver started at http://127.28.130.130:45905/ using document root <none> and password file <none>
I20240502 08:18:51.622817 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:51.622953 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:51.623101 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:51.624095 29353 heartbeater.cc:347] Connected to a master server at 127.28.130.190:35317
I20240502 08:18:51.624111 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-1-root/instance:
uuid: "f7462a6e2069459a94ad8bc917908dd7"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.624469 29353 heartbeater.cc:464] Registering TS with master...
I20240502 08:18:51.625345 29353 heartbeater.cc:511] Master 127.28.130.190:35317 requested a full tablet report, sending...
I20240502 08:18:51.627784 29224 ts_manager.cc:194] Registered new tserver with Master: 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193)
I20240502 08:18:51.628157 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 08:18:51.630267 29224 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43904
I20240502 08:18:51.630707 29365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.631152 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.001s
I20240502 08:18:51.631312 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
uuid: "f7462a6e2069459a94ad8bc917908dd7"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.631487 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:51.649503 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:18:51.650386 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:51.651124 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:18:51.652303 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:18:51.652397 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.652534 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:18:51.652601 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.671123 29427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.130:38687 every 8 connection(s)
I20240502 08:18:51.671159 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.130:38687
I20240502 08:18:51.673331 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:51.678588 29432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:51.679558 29431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:51.682248 29428 heartbeater.cc:347] Connected to a master server at 127.28.130.190:35317
I20240502 08:18:51.682432 29428 heartbeater.cc:464] Registering TS with master...
I20240502 08:18:51.682910 29428 heartbeater.cc:511] Master 127.28.130.190:35317 requested a full tablet report, sending...
I20240502 08:18:51.683946 29224 ts_manager.cc:194] Registered new tserver with Master: f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:51.684751 29224 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43914
I20240502 08:18:51.690649 29194 server_base.cc:1034] running on GCE node
W20240502 08:18:51.692016 29434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:51.692474 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:51.692588 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:51.692663 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637931692634 us; error 0 us; skew 500 ppm
I20240502 08:18:51.692875 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:51.694511 29194 webserver.cc:460] Webserver started at http://127.28.130.131:38867/ using document root <none> and password file <none>
I20240502 08:18:51.694774 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:51.694869 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:51.694994 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:51.695751 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-2-root/instance:
uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.698732 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 08:18:51.700981 29439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.701417 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240502 08:18:51.701568 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
format_stamp: "Formatted at 2024-05-02 08:18:51 on dist-test-slave-330p"
I20240502 08:18:51.701706 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714637931256210-29194-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:51.709877 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:18:51.710656 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:51.711350 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:18:51.712389 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:18:51.712499 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.712630 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:18:51.712720 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:18:51.733484 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.131:37023
I20240502 08:18:51.733566 29502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.131:37023 every 8 connection(s)
I20240502 08:18:51.742480 29503 heartbeater.cc:347] Connected to a master server at 127.28.130.190:35317
I20240502 08:18:51.742633 29503 heartbeater.cc:464] Registering TS with master...
I20240502 08:18:51.743170 29503 heartbeater.cc:511] Master 127.28.130.190:35317 requested a full tablet report, sending...
I20240502 08:18:51.744211 29224 ts_manager.cc:194] Registered new tserver with Master: 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:51.745051 29224 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43926
I20240502 08:18:51.745447 29194 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.010700271s
I20240502 08:18:51.746853 29194 test_util.cc:268] Using random seed: 1087837705
I20240502 08:18:51.772766 29224 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43934:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 08:18:51.775425 29224 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 08:18:51.825996 29391 tablet_service.cc:1467] Processing CreateTablet for tablet e41120a5a34f487e80e9b7b654e6a8ac (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 08:18:51.826856 29389 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9707d186f04bee9883097bdf76f270 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 08:18:51.827153 29391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41120a5a34f487e80e9b7b654e6a8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.827411 29389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9707d186f04bee9883097bdf76f270. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.827811 29390 tablet_service.cc:1467] Processing CreateTablet for tablet 77622c17b9284e17b0d292974ca2a3fd (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 08:18:51.828308 29390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77622c17b9284e17b0d292974ca2a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.828734 29392 tablet_service.cc:1467] Processing CreateTablet for tablet d0051a13be4f4bc3a6c00085a1d477fb (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 08:18:51.829289 29392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0051a13be4f4bc3a6c00085a1d477fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.831991 29393 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 08:18:51.832499 29393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.842939 29389 tablet_service.cc:1467] Processing CreateTablet for tablet 95bedea97e364e1c96c53db623bc180d (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 08:18:51.843420 29389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bedea97e364e1c96c53db623bc180d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.843891 29392 tablet_service.cc:1467] Processing CreateTablet for tablet da3d6325fb104d348d00d4b79e80ff20 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 08:18:51.844324 29392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3d6325fb104d348d00d4b79e80ff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.845975 29393 tablet_service.cc:1467] Processing CreateTablet for tablet a42284fd5443489ca0cb096229c68def (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 08:18:51.846421 29393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42284fd5443489ca0cb096229c68def. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.847079 29390 tablet_service.cc:1467] Processing CreateTablet for tablet 99857059fc594eba99ba397d7365ce27 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 08:18:51.848230 29390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99857059fc594eba99ba397d7365ce27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.851048 29518 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:51.854863 29518 tablet_bootstrap.cc:654] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.864643 29467 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 08:18:51.865352 29467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.865537 29466 tablet_service.cc:1467] Processing CreateTablet for tablet d0051a13be4f4bc3a6c00085a1d477fb (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 08:18:51.865996 29466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0051a13be4f4bc3a6c00085a1d477fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.867441 29464 tablet_service.cc:1467] Processing CreateTablet for tablet 77622c17b9284e17b0d292974ca2a3fd (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 08:18:51.866889 29465 tablet_service.cc:1467] Processing CreateTablet for tablet e41120a5a34f487e80e9b7b654e6a8ac (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 08:18:51.868026 29463 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9707d186f04bee9883097bdf76f270 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 08:18:51.868326 29318 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 08:18:51.871613 29464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77622c17b9284e17b0d292974ca2a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.871161 29314 tablet_service.cc:1467] Processing CreateTablet for tablet 2a9707d186f04bee9883097bdf76f270 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 08:18:51.872888 29318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac71ee46eb04edfb13b1c24bf0f2c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.872946 29463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9707d186f04bee9883097bdf76f270. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.869019 29312 tablet_service.cc:1467] Processing CreateTablet for tablet da3d6325fb104d348d00d4b79e80ff20 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 08:18:51.869300 29317 tablet_service.cc:1467] Processing CreateTablet for tablet d0051a13be4f4bc3a6c00085a1d477fb (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 08:18:51.869146 29461 tablet_service.cc:1467] Processing CreateTablet for tablet da3d6325fb104d348d00d4b79e80ff20 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 08:18:51.875808 29314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a9707d186f04bee9883097bdf76f270. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.869735 29316 tablet_service.cc:1467] Processing CreateTablet for tablet e41120a5a34f487e80e9b7b654e6a8ac (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 08:18:51.869714 29460 tablet_service.cc:1467] Processing CreateTablet for tablet a42284fd5443489ca0cb096229c68def (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 08:18:51.877875 29312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3d6325fb104d348d00d4b79e80ff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.870126 29315 tablet_service.cc:1467] Processing CreateTablet for tablet 77622c17b9284e17b0d292974ca2a3fd (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 08:18:51.878063 29465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41120a5a34f487e80e9b7b654e6a8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.878326 29461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3d6325fb104d348d00d4b79e80ff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.868554 29462 tablet_service.cc:1467] Processing CreateTablet for tablet 95bedea97e364e1c96c53db623bc180d (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 08:18:51.878804 29462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bedea97e364e1c96c53db623bc180d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.870273 29459 tablet_service.cc:1467] Processing CreateTablet for tablet 99857059fc594eba99ba397d7365ce27 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 08:18:51.881054 29317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0051a13be4f4bc3a6c00085a1d477fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.872206 29313 tablet_service.cc:1467] Processing CreateTablet for tablet 95bedea97e364e1c96c53db623bc180d (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 08:18:51.874622 29310 tablet_service.cc:1467] Processing CreateTablet for tablet 99857059fc594eba99ba397d7365ce27 (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 08:18:51.882282 29460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42284fd5443489ca0cb096229c68def. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.883016 29311 tablet_service.cc:1467] Processing CreateTablet for tablet a42284fd5443489ca0cb096229c68def (DEFAULT_TABLE table=test-workload [id=cd24f3dcc06e47cea8e3f99d0083903a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 08:18:51.884689 29315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77622c17b9284e17b0d292974ca2a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.884955 29518 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:51.885540 29311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42284fd5443489ca0cb096229c68def. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.886159 29459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99857059fc594eba99ba397d7365ce27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.892854 29518 ts_tablet_manager.cc:1367] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.000s
I20240502 08:18:51.894490 29310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99857059fc594eba99ba397d7365ce27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.896324 29316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41120a5a34f487e80e9b7b654e6a8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.912881 29521 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:51.916805 29313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bedea97e364e1c96c53db623bc180d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:51.941679 29521 tablet_bootstrap.cc:654] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.939814 29518 raft_consensus.cc:348] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.946485 29518 raft_consensus.cc:374] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:51.946738 29520 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:51.950317 29518 raft_consensus.cc:729] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:51.953735 29518 consensus_queue.cc:260] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.971405 29428 heartbeater.cc:503] Master 127.28.130.190:35317 was elected leader, sending a full tablet report...
I20240502 08:18:51.973788 29518 ts_tablet_manager.cc:1398] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.076s user 0.010s sys 0.006s
I20240502 08:18:51.974268 29518 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:51.975464 29521 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:51.975661 29521 ts_tablet_manager.cc:1367] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.009s
I20240502 08:18:51.976840 29520 tablet_bootstrap.cc:654] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.977591 29521 raft_consensus.cc:348] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.977859 29521 raft_consensus.cc:374] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:51.977983 29521 raft_consensus.cc:729] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:51.978421 29521 consensus_queue.cc:260] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.979008 29518 tablet_bootstrap.cc:654] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.982790 29521 ts_tablet_manager.cc:1398] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20240502 08:18:51.983028 29353 heartbeater.cc:503] Master 127.28.130.190:35317 was elected leader, sending a full tablet report...
I20240502 08:18:51.986781 29521 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:51.988770 29521 tablet_bootstrap.cc:654] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:51.984737 29520 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:51.990123 29520 ts_tablet_manager.cc:1367] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.007s
I20240502 08:18:51.991333 29520 raft_consensus.cc:348] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.991603 29520 raft_consensus.cc:374] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:51.991731 29520 raft_consensus.cc:729] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:51.992854 29520 consensus_queue.cc:260] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.996554 29518 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:51.996995 29521 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:51.997172 29518 ts_tablet_manager.cc:1367] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.006s
I20240502 08:18:51.997241 29521 ts_tablet_manager.cc:1367] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20240502 08:18:51.998875 29503 heartbeater.cc:503] Master 127.28.130.190:35317 was elected leader, sending a full tablet report...
I20240502 08:18:51.998818 29520 ts_tablet_manager.cc:1398] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.009s user 0.000s sys 0.006s
I20240502 08:18:51.998793 29521 raft_consensus.cc:348] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:51.999262 29521 raft_consensus.cc:374] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:51.999364 29520 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:51.999410 29521 raft_consensus.cc:729] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:51.999958 29518 raft_consensus.cc:348] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.000241 29518 raft_consensus.cc:374] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.000347 29518 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.000681 29518 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.001494 29518 ts_tablet_manager.cc:1398] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 08:18:52.001914 29518 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.002836 29520 tablet_bootstrap.cc:654] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.004319 29518 tablet_bootstrap.cc:654] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.014117 29521 consensus_queue.cc:260] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.015324 29521 ts_tablet_manager.cc:1398] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20240502 08:18:52.022926 29521 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.026108 29521 tablet_bootstrap.cc:654] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.030050 29518 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.030279 29518 ts_tablet_manager.cc:1367] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.022s
I20240502 08:18:52.031158 29518 raft_consensus.cc:348] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.031412 29518 raft_consensus.cc:374] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.031548 29518 raft_consensus.cc:729] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.031904 29518 consensus_queue.cc:260] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.032617 29518 ts_tablet_manager.cc:1398] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:18:52.034727 29520 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.035041 29520 ts_tablet_manager.cc:1367] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.023s
I20240502 08:18:52.036532 29520 raft_consensus.cc:348] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.036880 29522 raft_consensus.cc:482] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.036962 29520 raft_consensus.cc:374] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.037076 29520 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.037103 29522 raft_consensus.cc:504] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.037539 29520 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.038010 29518 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.038092 29520 ts_tablet_manager.cc:1398] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:18:52.039094 29522 leader_election.cc:288] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.039820 29520 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.042472 29520 tablet_bootstrap.cc:654] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.049039 29521 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.049382 29521 ts_tablet_manager.cc:1367] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.000s
I20240502 08:18:52.050669 29521 raft_consensus.cc:348] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.051172 29521 raft_consensus.cc:374] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.051244 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.054849 29520 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.055929 29520 ts_tablet_manager.cc:1367] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20240502 08:18:52.056097 29521 raft_consensus.cc:729] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
W20240502 08:18:52.057219 29368 leader_election.cc:341] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.057346 29521 consensus_queue.cc:260] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.058051 29518 tablet_bootstrap.cc:654] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.058583 29521 ts_tablet_manager.cc:1398] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20240502 08:18:52.059037 29521 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.063810 29520 raft_consensus.cc:348] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.064086 29520 raft_consensus.cc:374] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.064311 29520 raft_consensus.cc:729] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.064646 29520 consensus_queue.cc:260] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.065663 29525 raft_consensus.cc:482] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.066607 29520 ts_tablet_manager.cc:1398] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20240502 08:18:52.067170 29520 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.065896 29525 raft_consensus.cc:504] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.067694 29521 tablet_bootstrap.cc:654] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.071074 29525 leader_election.cc:288] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.071576 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.074142 29518 tablet_bootstrap.cc:492] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.074489 29518 ts_tablet_manager.cc:1367] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.000s
W20240502 08:18:52.075497 29366 leader_election.cc:341] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.075736 29366 leader_election.cc:302] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7462a6e2069459a94ad8bc917908dd7; no voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:18:52.075663 29518 raft_consensus.cc:348] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.076097 29522 raft_consensus.cc:2726] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:18:52.076349 29518 raft_consensus.cc:374] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.076495 29518 raft_consensus.cc:729] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.076814 29518 consensus_queue.cc:260] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.077459 29518 ts_tablet_manager.cc:1398] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:18:52.077804 29518 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.079411 29518 tablet_bootstrap.cc:654] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.085915 29520 tablet_bootstrap.cc:654] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
W20240502 08:18:52.094066 29354 tablet.cc:2369] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 08:18:52.096204 29518 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.096402 29518 ts_tablet_manager.cc:1367] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.009s
I20240502 08:18:52.097206 29518 raft_consensus.cc:348] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.097405 29518 raft_consensus.cc:374] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.097514 29518 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.097822 29518 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.100960 29518 ts_tablet_manager.cc:1398] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 08:18:52.101368 29518 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.103873 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.104409 29521 tablet_bootstrap.cc:492] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.104369 29403 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.104593 29521 ts_tablet_manager.cc:1367] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.006s
I20240502 08:18:52.105054 29518 tablet_bootstrap.cc:654] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.105274 29294 leader_election.cc:302] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.105595 29525 raft_consensus.cc:2781] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.105504 29521 raft_consensus.cc:348] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.105708 29525 raft_consensus.cc:482] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.105765 29521 raft_consensus.cc:374] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.105818 29525 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.105856 29521 raft_consensus.cc:729] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.106148 29521 consensus_queue.cc:260] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.109773 29525 raft_consensus.cc:504] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.109840 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.110179 29478 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.111057 29525 leader_election.cc:288] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.111057 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.111407 29403 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.112461 29520 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.112663 29520 ts_tablet_manager.cc:1367] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.004s
I20240502 08:18:52.113598 29520 raft_consensus.cc:348] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.113852 29520 raft_consensus.cc:374] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.113955 29520 raft_consensus.cc:729] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.114375 29520 consensus_queue.cc:260] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.115171 29520 ts_tablet_manager.cc:1398] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240502 08:18:52.115540 29520 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.117623 29520 tablet_bootstrap.cc:654] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.121558 29528 raft_consensus.cc:482] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.121776 29528 raft_consensus.cc:504] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.123200 29528 leader_election.cc:288] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:52.125583 29520 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.125788 29520 ts_tablet_manager.cc:1367] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20240502 08:18:52.126089 29403 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.126721 29294 leader_election.cc:302] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.126892 29520 raft_consensus.cc:348] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.127207 29520 raft_consensus.cc:374] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.127209 29525 raft_consensus.cc:2781] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.127349 29520 raft_consensus.cc:729] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.127408 29525 raft_consensus.cc:686] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.127616 29520 consensus_queue.cc:260] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.127712 29525 consensus_queue.cc:237] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.129887 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.130149 29478 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.130290 29520 ts_tablet_manager.cc:1398] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:18:52.130683 29520 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.145203 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.146030 29528 raft_consensus.cc:482] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.146317 29528 raft_consensus.cc:504] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.147368 29528 leader_election.cc:288] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193)
W20240502 08:18:52.148387 29442 leader_election.cc:341] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.149210 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.149507 29328 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 0.
I20240502 08:18:52.150194 29442 leader_election.cc:302] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:52.150791 29528 raft_consensus.cc:2781] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.150930 29528 raft_consensus.cc:482] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.151073 29528 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.161080 29520 tablet_bootstrap.cc:654] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.163403 29478 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.164979 29528 raft_consensus.cc:504] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.167483 29544 raft_consensus.cc:482] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.167716 29544 raft_consensus.cc:504] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.168920 29544 leader_election.cc:288] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.169004 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.169301 29328 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.176800 29522 raft_consensus.cc:482] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.177026 29522 raft_consensus.cc:504] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.177490 29328 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
I20240502 08:18:52.177829 29522 leader_election.cc:288] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.178252 29522 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.178508 29522 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.178649 29442 leader_election.cc:302] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:52.179347 29522 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.179963 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.180387 29477 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 0.
I20240502 08:18:52.180256 29327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.180817 29327 raft_consensus.cc:2379] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7462a6e2069459a94ad8bc917908dd7 in current term 1: Already voted for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in this term.
I20240502 08:18:52.181020 29366 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.181506 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
W20240502 08:18:52.182885 29368 leader_election.cc:341] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.182595 29224 catalog_manager.cc:5484] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.183432 29522 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.185963 29522 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.186164 29522 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.190865 29522 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.192844 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.193154 29477 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.197659 29477 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 1.
I20240502 08:18:52.198588 29366 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.183876 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.184211 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.203660 29478 raft_consensus.cc:2379] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7462a6e2069459a94ad8bc917908dd7 in current term 1: Already voted for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in this term.
W20240502 08:18:52.203809 29294 leader_election.cc:341] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.204895 29522 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.205235 29522 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.205442 29522 raft_consensus.cc:686] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.205861 29522 consensus_queue.cc:237] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.192836 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
W20240502 08:18:52.212395 29368 leader_election.cc:341] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.212955 29528 leader_election.cc:288] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193)
I20240502 08:18:52.213469 29528 raft_consensus.cc:2781] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.214315 29528 raft_consensus.cc:686] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.217021 29528 consensus_queue.cc:237] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.222327 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
W20240502 08:18:52.224856 29291 leader_election.cc:341] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.225060 29401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.232563 29401 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.224881 29402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.225580 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.238204 29401 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
W20240502 08:18:52.239503 29443 leader_election.cc:341] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.239694 29443 leader_election.cc:302] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.228647 29223 catalog_manager.cc:5484] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 1 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.252205 29291 leader_election.cc:302] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860; no voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.253618 29525 raft_consensus.cc:2726] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:18:52.262215 29546 raft_consensus.cc:2726] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 08:18:52.264760 29442 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.130.129:33193, user_credentials={real_user=slave}} blocked reactor thread for 86124.8us
I20240502 08:18:52.266891 29223 catalog_manager.cc:5484] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:52.272830 29525 raft_consensus.cc:482] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.273120 29525 raft_consensus.cc:504] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.274097 29525 leader_election.cc:288] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.274600 29401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.275106 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
W20240502 08:18:52.275382 29294 leader_election.cc:341] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687): Illegal state: must be running to vote when last-logged opid is not known
W20240502 08:18:52.275949 29291 leader_election.cc:341] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.276202 29291 leader_election.cc:302] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860; no voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.276605 29525 raft_consensus.cc:2726] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 08:18:52.277375 29366 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.130.131:37023, user_credentials={real_user=slave}} blocked reactor thread for 78975.5us
I20240502 08:18:52.277822 29366 leader_election.cc:302] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7462a6e2069459a94ad8bc917908dd7; no voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:18:52.279678 29547 raft_consensus.cc:2726] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:18:52.282236 29520 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.282485 29521 ts_tablet_manager.cc:1398] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.178s user 0.061s sys 0.104s
I20240502 08:18:52.282487 29520 ts_tablet_manager.cc:1367] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.152s user 0.040s sys 0.018s
I20240502 08:18:52.282918 29521 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.283509 29520 raft_consensus.cc:348] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.283934 29520 raft_consensus.cc:374] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.284056 29520 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.284385 29520 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.284922 29520 ts_tablet_manager.cc:1398] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:18:52.285140 29521 tablet_bootstrap.cc:654] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.285257 29520 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.287005 29520 tablet_bootstrap.cc:654] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.293026 29518 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.293337 29518 ts_tablet_manager.cc:1367] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.192s user 0.065s sys 0.090s
I20240502 08:18:52.293394 29521 tablet_bootstrap.cc:492] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.293609 29521 ts_tablet_manager.cc:1367] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240502 08:18:52.294589 29518 raft_consensus.cc:348] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.294888 29518 raft_consensus.cc:374] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.295006 29518 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.295328 29518 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.295548 29520 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.295728 29520 ts_tablet_manager.cc:1367] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20240502 08:18:52.295873 29518 ts_tablet_manager.cc:1398] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:18:52.296165 29518 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.296950 29520 raft_consensus.cc:348] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.297170 29520 raft_consensus.cc:374] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.297272 29520 raft_consensus.cc:729] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.297475 29520 consensus_queue.cc:260] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.297966 29518 tablet_bootstrap.cc:654] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.297992 29520 ts_tablet_manager.cc:1398] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:18:52.298290 29520 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.299207 29521 raft_consensus.cc:348] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.299434 29521 raft_consensus.cc:374] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.299542 29521 raft_consensus.cc:729] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.299762 29521 consensus_queue.cc:260] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.300051 29520 tablet_bootstrap.cc:654] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.300343 29521 ts_tablet_manager.cc:1398] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.007s user 0.000s sys 0.000s
I20240502 08:18:52.301244 29521 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.303025 29521 tablet_bootstrap.cc:654] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.307849 29518 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.307943 29520 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.308027 29518 ts_tablet_manager.cc:1367] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20240502 08:18:52.308079 29520 ts_tablet_manager.cc:1367] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20240502 08:18:52.308946 29520 raft_consensus.cc:348] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.309193 29520 raft_consensus.cc:374] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.309265 29520 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.309507 29520 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.310081 29520 ts_tablet_manager.cc:1398] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:18:52.310715 29518 raft_consensus.cc:348] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.310935 29518 raft_consensus.cc:374] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.311033 29518 raft_consensus.cc:729] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.311239 29518 consensus_queue.cc:260] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.311762 29518 ts_tablet_manager.cc:1398] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:18:52.312096 29518 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.313805 29518 tablet_bootstrap.cc:654] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.314796 29520 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Bootstrap starting.
I20240502 08:18:52.320060 29521 tablet_bootstrap.cc:492] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.320276 29521 ts_tablet_manager.cc:1367] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.007s
I20240502 08:18:52.321256 29520 tablet_bootstrap.cc:654] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.321198 29521 raft_consensus.cc:348] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.321455 29521 raft_consensus.cc:374] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.321564 29521 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.321954 29521 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.322700 29521 ts_tablet_manager.cc:1398] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:18:52.323033 29521 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.324892 29521 tablet_bootstrap.cc:654] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.329013 29540 raft_consensus.cc:482] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.329094 29518 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.329301 29518 ts_tablet_manager.cc:1367] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.008s
I20240502 08:18:52.329222 29540 raft_consensus.cc:504] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.330178 29518 raft_consensus.cc:348] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.330511 29518 raft_consensus.cc:374] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.330648 29518 raft_consensus.cc:729] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.330935 29518 consensus_queue.cc:260] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.330457 29540 leader_election.cc:288] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.331310 29401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.331492 29401 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.331516 29518 ts_tablet_manager.cc:1398] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:18:52.331609 29520 tablet_bootstrap.cc:492] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: No bootstrap required, opened a new log
I20240502 08:18:52.331744 29520 ts_tablet_manager.cc:1367] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.002s
I20240502 08:18:52.331890 29518 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: Bootstrap starting.
I20240502 08:18:52.331980 29294 leader_election.cc:302] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.331264 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.332283 29478 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.332513 29520 raft_consensus.cc:348] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.332754 29520 raft_consensus.cc:374] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.332873 29520 raft_consensus.cc:729] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.333154 29520 consensus_queue.cc:260] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.333755 29520 ts_tablet_manager.cc:1398] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:18:52.333796 29518 tablet_bootstrap.cc:654] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.335870 29518 tablet_bootstrap.cc:492] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: No bootstrap required, opened a new log
I20240502 08:18:52.336037 29518 ts_tablet_manager.cc:1367] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:18:52.336068 29540 raft_consensus.cc:2781] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.336206 29540 raft_consensus.cc:482] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.336346 29540 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.336766 29518 raft_consensus.cc:348] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.336942 29518 raft_consensus.cc:374] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.337050 29518 raft_consensus.cc:729] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.337283 29518 consensus_queue.cc:260] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.337837 29518 ts_tablet_manager.cc:1398] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:18:52.339000 29528 raft_consensus.cc:482] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.339162 29528 raft_consensus.cc:504] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.339339 29521 tablet_bootstrap.cc:492] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.339486 29521 ts_tablet_manager.cc:1367] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20240502 08:18:52.339582 29540 raft_consensus.cc:504] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.339952 29528 leader_election.cc:288] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:52.340335 29521 raft_consensus.cc:348] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.340538 29401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.340814 29401 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 0.
I20240502 08:18:52.340517 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.340539 29521 raft_consensus.cc:374] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.341078 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.341153 29521 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.341296 29328 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 0.
I20240502 08:18:52.341323 29443 leader_election.cc:302] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.341396 29521 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.341050 29403 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.341814 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.341981 29521 ts_tablet_manager.cc:1398] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:18:52.341989 29478 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.342260 29521 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.343760 29521 tablet_bootstrap.cc:654] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.344902 29403 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.345815 29528 raft_consensus.cc:2781] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.345965 29294 leader_election.cc:302] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.346660 29478 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.346704 29528 raft_consensus.cc:482] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.347563 29528 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.349949 29528 raft_consensus.cc:504] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.346755 29525 raft_consensus.cc:2781] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.350518 29525 raft_consensus.cc:686] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.350777 29525 consensus_queue.cc:237] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.353569 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.353762 29540 leader_election.cc:288] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.353818 29328 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.354722 29223 catalog_manager.cc:5484] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.355437 29521 tablet_bootstrap.cc:492] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.355623 29521 ts_tablet_manager.cc:1367] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20240502 08:18:52.356158 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.356367 29403 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.356400 29328 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
I20240502 08:18:52.356557 29521 raft_consensus.cc:348] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.356828 29521 raft_consensus.cc:374] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.356910 29521 raft_consensus.cc:729] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.357110 29442 leader_election.cc:302] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:52.357177 29521 consensus_queue.cc:260] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.357390 29550 raft_consensus.cc:2781] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.357582 29550 raft_consensus.cc:686] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.357771 29521 ts_tablet_manager.cc:1398] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:18:52.357908 29550 consensus_queue.cc:237] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.358196 29521 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: Bootstrap starting.
I20240502 08:18:52.353662 29528 leader_election.cc:288] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:52.359558 29403 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
I20240502 08:18:52.360155 29521 tablet_bootstrap.cc:654] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:52.360560 29546 raft_consensus.cc:482] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.360713 29546 raft_consensus.cc:504] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.361526 29546 leader_election.cc:288] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:52.362103 29521 tablet_bootstrap.cc:492] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: No bootstrap required, opened a new log
I20240502 08:18:52.362069 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.362252 29521 ts_tablet_manager.cc:1367] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:18:52.362396 29403 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 0.
I20240502 08:18:52.362558 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.362933 29443 leader_election.cc:302] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.363163 29521 raft_consensus.cc:348] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.363399 29521 raft_consensus.cc:374] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:52.363510 29521 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Initialized, Role: FOLLOWER
I20240502 08:18:52.363811 29521 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.364269 29521 ts_tablet_manager.cc:1398] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:18:52.363927 29222 catalog_manager.cc:5484] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
W20240502 08:18:52.365265 29442 leader_election.cc:341] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:18:52.365625 29550 raft_consensus.cc:2781] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.365751 29550 raft_consensus.cc:482] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.365850 29550 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.368489 29550 raft_consensus.cc:504] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.369067 29550 leader_election.cc:288] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:52.369395 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.369519 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.369655 29328 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.369768 29403 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.372821 29403 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
I20240502 08:18:52.372825 29328 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 1.
I20240502 08:18:52.373382 29443 leader_election.cc:302] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.373730 29550 raft_consensus.cc:2781] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.373870 29550 raft_consensus.cc:686] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.374135 29550 consensus_queue.cc:237] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.376783 29222 catalog_manager.cc:5484] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:52.411010 29547 raft_consensus.cc:482] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.411293 29547 raft_consensus.cc:504] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.412066 29547 leader_election.cc:288] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.412632 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.412637 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.412909 29328 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 0.
I20240502 08:18:52.412937 29478 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 0.
I20240502 08:18:52.413357 29366 leader_election.cc:302] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.413654 29547 raft_consensus.cc:2781] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.413770 29547 raft_consensus.cc:482] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.413893 29547 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.415542 29540 raft_consensus.cc:482] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.415699 29540 raft_consensus.cc:504] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.416025 29547 raft_consensus.cc:504] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.416358 29540 leader_election.cc:288] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.416674 29547 leader_election.cc:288] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.416884 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.416986 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.417114 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.417160 29478 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.417259 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.417326 29477 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.417501 29328 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.417667 29291 leader_election.cc:302] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:52.417966 29540 raft_consensus.cc:2781] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.418089 29540 raft_consensus.cc:482] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.418210 29540 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.417260 29403 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 0.
I20240502 08:18:52.420537 29540 raft_consensus.cc:504] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.420764 29328 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 1.
I20240502 08:18:52.420764 29477 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 1.
I20240502 08:18:52.421216 29368 leader_election.cc:302] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.421584 29540 leader_election.cc:288] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.421739 29547 raft_consensus.cc:2781] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.421895 29547 raft_consensus.cc:686] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.421835 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.422046 29403 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.422140 29547 consensus_queue.cc:237] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.422434 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.422631 29477 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.425310 29222 catalog_manager.cc:5484] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 1 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.425907 29403 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.425907 29477 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 1.
I20240502 08:18:52.426460 29294 leader_election.cc:302] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.426751 29540 raft_consensus.cc:2781] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.426903 29540 raft_consensus.cc:686] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.427198 29540 consensus_queue.cc:237] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.429930 29222 catalog_manager.cc:5484] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
W20240502 08:18:52.450021 29271 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 08:18:52.466445 29547 raft_consensus.cc:482] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.466662 29547 raft_consensus.cc:504] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.467417 29547 leader_election.cc:288] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.467960 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.467965 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" is_pre_election: true
I20240502 08:18:52.468274 29328 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 0.
I20240502 08:18:52.468281 29477 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 0.
I20240502 08:18:52.468724 29366 leader_election.cc:302] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.468998 29547 raft_consensus.cc:2781] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:18:52.469120 29547 raft_consensus.cc:482] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:18:52.469194 29547 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.471251 29547 raft_consensus.cc:504] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.471930 29547 leader_election.cc:288] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.472357 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.472368 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.472554 29477 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.472576 29328 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.474690 29477 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 1.
I20240502 08:18:52.474733 29328 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 1.
I20240502 08:18:52.475201 29366 leader_election.cc:302] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.475541 29547 raft_consensus.cc:2781] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:52.475693 29547 raft_consensus.cc:686] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.475980 29547 consensus_queue.cc:237] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.478580 29222 catalog_manager.cc:5484] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 1 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.551156 29540 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.552172 29540 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:18:52.552368 29540 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.553304 29540 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.553543 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7462a6e2069459a94ad8bc917908dd7" is_pre_election: true
I20240502 08:18:52.553547 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" is_pre_election: true
I20240502 08:18:52.553997 29478 raft_consensus.cc:2379] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 246ac5ec788a4b3e80e6a724fc8c9860 in current term 1: Already voted for candidate f7462a6e2069459a94ad8bc917908dd7 in this term.
I20240502 08:18:52.554468 29291 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860; no voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.554833 29540 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:52.556813 29540 raft_consensus.cc:2726] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:18:52.562127 29570 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.581358 29477 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:48626
I20240502 08:18:52.581686 29477 raft_consensus.cc:595] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:18:52.589008 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:57630
I20240502 08:18:52.589237 29403 raft_consensus.cc:595] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:18:52.592844 29477 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:48626
I20240502 08:18:52.593091 29477 raft_consensus.cc:595] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:18:52.600103 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:56078
I20240502 08:18:52.600373 29328 raft_consensus.cc:595] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.604055 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:56078
I20240502 08:18:52.604372 29328 raft_consensus.cc:595] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.606379 29477 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a42284fd5443489ca0cb096229c68def"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:48626
I20240502 08:18:52.606580 29477 raft_consensus.cc:595] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:18:52.608513 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "99857059fc594eba99ba397d7365ce27"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:57630
I20240502 08:18:52.608700 29403 raft_consensus.cc:595] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Received request to transfer leadership to TS 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:18:52.701368 29547 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.704643 29522 raft_consensus.cc:979] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.704874 29522 raft_consensus.cc:1067] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.706194 29328 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56048
I20240502 08:18:52.706552 29328 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:52.706710 29328 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.707995 29547 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.711455 29328 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.712412 29328 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.712523 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.712692 29403 raft_consensus.cc:3032] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:52.712783 29403 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.713114 29403 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.713687 29403 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.715734 29403 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.716142 29294 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.716091 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.716326 29477 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.716574 29570 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:52.716779 29570 raft_consensus.cc:686] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.717154 29570 consensus_queue.cc:237] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.718706 29477 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.719632 29222 catalog_manager.cc:5484] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 1 to 2, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.724092 29550 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.728124 29550 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.730654 29546 raft_consensus.cc:979] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.730808 29546 raft_consensus.cc:1067] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.731405 29328 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56062
I20240502 08:18:52.731626 29328 raft_consensus.cc:482] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:52.731770 29328 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.733708 29328 raft_consensus.cc:504] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.734640 29328 leader_election.cc:288] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.734714 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.734916 29403 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.734892 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.735087 29477 raft_consensus.cc:3032] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:52.735179 29477 raft_consensus.cc:729] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.735463 29477 consensus_queue.cc:260] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.735750 29477 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.737658 29403 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.738103 29294 leader_election.cc:302] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.738152 29477 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.738479 29570 raft_consensus.cc:2781] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:52.738634 29570 raft_consensus.cc:686] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.738920 29570 consensus_queue.cc:237] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.741051 29223 catalog_manager.cc:5484] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 1 to 2, leader changed from 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.768805 29550 consensus_queue.cc:1035] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.773248 29550 consensus_queue.cc:1035] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.777508 29528 raft_consensus.cc:979] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:52.777714 29550 raft_consensus.cc:1067] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:52.778332 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a42284fd5443489ca0cb096229c68def"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57624
I20240502 08:18:52.778621 29403 raft_consensus.cc:482] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:52.778756 29403 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.780947 29403 raft_consensus.cc:504] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.782101 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.782213 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42284fd5443489ca0cb096229c68def" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.782462 29328 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.782459 29477 raft_consensus.cc:3032] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:52.782529 29403 leader_election.cc:288] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.782696 29477 raft_consensus.cc:729] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.783181 29477 consensus_queue.cc:260] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.783542 29477 raft_consensus.cc:3037] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.784965 29328 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:52.785401 29368 leader_election.cc:302] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.785581 29477 raft_consensus.cc:2454] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:52.785710 29547 raft_consensus.cc:2781] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:52.785938 29547 raft_consensus.cc:686] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.786252 29547 consensus_queue.cc:237] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.788614 29222 catalog_manager.cc:5484] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 1 to 2, leader changed from 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 2 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.812969 29550 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.815784 29550 raft_consensus.cc:979] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.815990 29550 raft_consensus.cc:1067] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:18:52.816622 29326 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56062
I20240502 08:18:52.816874 29326 raft_consensus.cc:482] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:52.817024 29326 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.817576 29550 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.820281 29326 raft_consensus.cc:504] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.820730 29328 raft_consensus.cc:1226] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Rejecting Update request from peer 5f7b2db66a24404ea5cf7dab9ef9fb78 for earlier term 1. Current term is 2. Ops: []
I20240502 08:18:52.821139 29326 leader_election.cc:288] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.821494 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.821702 29477 raft_consensus.cc:3032] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:52.821801 29477 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:52.822089 29477 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.822530 29477 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
W20240502 08:18:52.822484 29550 consensus_queue.cc:1159] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5f7b2db66a24404ea5cf7dab9ef9fb78 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20240502 08:18:52.823979 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:52.824162 29403 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.825315 29477 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.825762 29291 leader_election.cc:302] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:52.826056 29544 raft_consensus.cc:2781] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:52.826238 29544 raft_consensus.cc:686] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.826670 29403 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:18:52.826598 29544 consensus_queue.cc:237] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.828951 29222 catalog_manager.cc:5484] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 1 to 2, leader changed from 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.896299 29544 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.900183 29540 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.905175 29540 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.909193 29544 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.911900 29570 raft_consensus.cc:979] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:52.912088 29570 raft_consensus.cc:1067] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:52.912710 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57608
I20240502 08:18:52.912892 29403 raft_consensus.cc:482] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:52.913028 29403 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.915550 29403 raft_consensus.cc:504] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.916121 29403 leader_election.cc:288] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:52.916504 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:52.916584 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:52.916740 29328 raft_consensus.cc:3032] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:52.916803 29477 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.916832 29328 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:52.917076 29328 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.917385 29328 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:52.919085 29477 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:52.919451 29328 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:52.919514 29366 leader_election.cc:302] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:52.919855 29547 raft_consensus.cc:2781] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:52.919987 29547 raft_consensus.cc:686] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:52.920259 29547 consensus_queue.cc:237] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:52.922668 29222 catalog_manager.cc:5484] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 1 to 2, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 2 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:52.959607 29547 consensus_queue.cc:1035] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:52.964391 29576 consensus_queue.cc:1035] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:53.029361 29576 consensus_queue.cc:1035] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:53.029721 29522 consensus_queue.cc:1035] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:18:53.033576 29576 raft_consensus.cc:979] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:53.033753 29576 raft_consensus.cc:1067] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Signalling peer 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:53.034727 29478 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "99857059fc594eba99ba397d7365ce27"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:48610
I20240502 08:18:53.034996 29478 raft_consensus.cc:482] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:53.035132 29478 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.037956 29478 raft_consensus.cc:504] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.038712 29478 leader_election.cc:288] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 2 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:53.038995 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:53.039247 29328 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.039279 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99857059fc594eba99ba397d7365ce27" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:53.039469 29403 raft_consensus.cc:3032] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:53.039580 29403 raft_consensus.cc:729] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:53.039899 29403 consensus_queue.cc:260] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.040307 29403 raft_consensus.cc:3037] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.041572 29328 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 2.
I20240502 08:18:53.041958 29442 leader_election.cc:302] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:53.042258 29550 raft_consensus.cc:2781] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:53.042433 29550 raft_consensus.cc:686] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:53.042595 29403 raft_consensus.cc:2454] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 2.
I20240502 08:18:53.042702 29550 consensus_queue.cc:237] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.044636 29223 catalog_manager.cc:5484] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 1 to 2, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 2 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:53.147915 29403 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.148514 29570 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.151566 29478 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.152508 29592 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.176030 29540 raft_consensus.cc:979] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:53.176254 29540 raft_consensus.cc:1067] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:18:53.176851 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57608
I20240502 08:18:53.177121 29403 raft_consensus.cc:482] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:53.177258 29403 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.179234 29403 raft_consensus.cc:504] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.179862 29403 leader_election.cc:288] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:18:53.180248 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:18:53.180439 29478 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.181023 29326 raft_consensus.cc:1261] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.181356 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:53.181558 29328 raft_consensus.cc:3032] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:18:53.181646 29328 raft_consensus.cc:729] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:53.181597 29522 consensus_queue.cc:1035] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.181893 29328 consensus_queue.cc:260] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.182245 29328 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:18:53.184147 29478 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:53.184965 29366 leader_election.cc:302] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:53.185284 29547 raft_consensus.cc:2781] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:18:53.185436 29547 raft_consensus.cc:686] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:53.185631 29328 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:18:53.185782 29547 consensus_queue.cc:237] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:53.186246 29477 raft_consensus.cc:1261] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.187369 29576 consensus_queue.cc:1035] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.189194 29222 catalog_manager.cc:5484] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 1 to 2, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 2 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:18:53.247213 29403 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.247769 29540 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.251341 29477 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.251986 29592 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.300547 29477 raft_consensus.cc:1261] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.301211 29592 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.304303 29403 raft_consensus.cc:1261] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.304827 29592 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.398684 29328 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.399294 29576 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.402384 29477 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.403190 29547 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.452173 29328 raft_consensus.cc:1261] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.452930 29550 consensus_queue.cc:1035] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.456349 29403 raft_consensus.cc:1261] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.456861 29550 consensus_queue.cc:1035] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.717447 29328 raft_consensus.cc:1261] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.718124 29593 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:53.721966 29477 raft_consensus.cc:1261] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:18:53.722582 29593 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:18:55.618690 29194 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240502 08:18:55.619047 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:18:55.626998 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:44650
I20240502 08:18:55.627264 29328 raft_consensus.cc:595] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Received request to transfer leadership to TS 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:18:55.633291 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:18:55.633538 29403 raft_consensus.cc:595] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Received request to transfer leadership to TS 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:18:55.634070 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 08:18:55.634394 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:18:55.926661 29540 raft_consensus.cc:979] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:55.926838 29540 raft_consensus.cc:1067] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Signalling peer 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:55.927544 29477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:48620
I20240502 08:18:55.927779 29477 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:55.927898 29477 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:55.929826 29477 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:55.930447 29477 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:55.930941 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:55.930954 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:55.931166 29403 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:55.931195 29328 raft_consensus.cc:3032] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:18:55.931305 29328 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:18:55.931644 29328 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:55.931965 29328 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:55.933461 29403 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:18:55.933926 29443 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:18:55.933985 29328 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:18:55.934317 29597 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:18:55.934819 29597 raft_consensus.cc:686] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:55.935195 29597 consensus_queue.cc:237] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:55.937860 29223 catalog_manager.cc:5484] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 2 to 3, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 3 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:56.028007 29576 raft_consensus.cc:979] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:56.028235 29608 raft_consensus.cc:1067] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Signalling peer 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:18:56.029083 29477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:48610
I20240502 08:18:56.029347 29477 raft_consensus.cc:482] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:18:56.029485 29477 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:56.032511 29477 raft_consensus.cc:504] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:56.033294 29477 leader_election.cc:288] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:18:56.034819 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:18:56.035039 29328 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:56.037861 29328 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:18:56.038316 29442 leader_election.cc:302] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:18:56.038652 29597 raft_consensus.cc:2781] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:18:56.038839 29597 raft_consensus.cc:686] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:18:56.039160 29597 consensus_queue.cc:237] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:56.039599 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:18:56.039810 29403 raft_consensus.cc:3032] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:18:56.039925 29403 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:18:56.040181 29403 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:18:56.040624 29403 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:18:56.043072 29403 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:18:56.044171 29223 catalog_manager.cc:5484] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 2 to 3, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 3 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:56.357779 29403 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:18:56.358399 29597 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:18:56.362447 29328 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:18:56.363101 29597 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:18:56.519578 29328 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:18:56.520269 29597 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:18:56.524062 29403 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:18:56.524751 29597 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:18:56.634810 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:18:56.636417 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:18:56.636617 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:18:57.637044 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:18:57.639138 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:18:57.639318 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:18:58.639748 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:18:58.641423 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:18:58.641608 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:18:59.642025 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:18:59.643644 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:18:59.643777 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:00.644191 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:00.646029 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:00.646221 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:01.646777 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:01.648519 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:01.648718 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:02.649176 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:02.650770 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:02.650972 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:03.651463 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:03.653052 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:03.653249 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:04.653730 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:04.655797 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:04.656009 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:05.665550 29194 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240502 08:19:05.667331 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:56078
I20240502 08:19:05.667547 29328 raft_consensus.cc:595] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:19:05.669390 29478 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:48626
I20240502 08:19:05.669554 29478 raft_consensus.cc:595] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:19:05.671370 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:56078
I20240502 08:19:05.671523 29328 raft_consensus.cc:595] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:19:05.673370 29328 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:56078
I20240502 08:19:05.673522 29328 raft_consensus.cc:595] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:19:05.677138 29478 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
mode: GRACEFUL
new_leader_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:48626
I20240502 08:19:05.677299 29478 raft_consensus.cc:595] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Received request to transfer leadership to TS f7462a6e2069459a94ad8bc917908dd7
I20240502 08:19:05.724529 29616 raft_consensus.cc:979] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.724699 29616 raft_consensus.cc:1067] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.725320 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57624
I20240502 08:19:05.725492 29403 raft_consensus.cc:482] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:05.725586 29403 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.727535 29403 raft_consensus.cc:504] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.728168 29403 leader_election.cc:288] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 4 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:05.728487 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:05.728682 29328 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.728739 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3d6325fb104d348d00d4b79e80ff20" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:05.728899 29478 raft_consensus.cc:3032] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:05.729007 29478 raft_consensus.cc:729] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:19:05.729279 29478 consensus_queue.cc:260] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.729688 29478 raft_consensus.cc:3037] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.731673 29328 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 4.
I20240502 08:19:05.732069 29368 leader_election.cc:302] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:19:05.732252 29478 raft_consensus.cc:2454] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 4.
I20240502 08:19:05.732405 29620 raft_consensus.cc:2781] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:05.732946 29620 raft_consensus.cc:686] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:05.733289 29620 consensus_queue.cc:237] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.735797 29223 catalog_manager.cc:5484] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 3 to 4, leader changed from 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 4 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:05.740144 29540 raft_consensus.cc:979] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.740265 29540 raft_consensus.cc:1067] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.740842 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57608
I20240502 08:19:05.741060 29403 raft_consensus.cc:482] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:05.741159 29403 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:05.743276 29403 raft_consensus.cc:504] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.743868 29403 leader_election.cc:288] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 3 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:05.744230 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:05.744341 29478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac71ee46eb04edfb13b1c24bf0f2c9c" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:05.744419 29328 raft_consensus.cc:3032] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:05.744514 29328 raft_consensus.cc:729] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:05.744547 29478 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:05.744808 29328 consensus_queue.cc:260] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.745048 29328 raft_consensus.cc:3037] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:05.746632 29478 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 3.
I20240502 08:19:05.746876 29328 raft_consensus.cc:2454] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 3.
I20240502 08:19:05.747043 29366 leader_election.cc:302] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:19:05.747327 29620 raft_consensus.cc:2781] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:05.747483 29620 raft_consensus.cc:686] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:05.747758 29620 consensus_queue.cc:237] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.750074 29223 catalog_manager.cc:5484] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 2 to 3, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 3 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:05.785965 29621 raft_consensus.cc:979] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.786185 29621 raft_consensus.cc:1067] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:05.786970 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57624
I20240502 08:19:05.787178 29403 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:05.787313 29403 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.789258 29403 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.789824 29403 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 4 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:05.790225 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:05.790242 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:05.790453 29477 raft_consensus.cc:3032] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:05.790480 29328 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.790537 29477 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:19:05.790829 29477 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.791129 29477 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:05.792538 29328 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 4.
I20240502 08:19:05.792934 29368 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:19:05.793188 29477 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 4.
I20240502 08:19:05.793247 29620 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:05.793418 29620 raft_consensus.cc:686] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:05.793692 29620 consensus_queue.cc:237] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:05.796244 29223 catalog_manager.cc:5484] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 3 to 4, leader changed from 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 4 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:06.028611 29628 raft_consensus.cc:979] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:06.028815 29628 raft_consensus.cc:1067] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:06.029506 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57608
I20240502 08:19:06.029704 29403 raft_consensus.cc:482] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:06.029801 29403 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:06.031867 29403 raft_consensus.cc:504] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.032647 29403 leader_election.cc:288] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 3 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:06.033200 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:06.033310 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:06.033481 29328 raft_consensus.cc:3032] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:06.033557 29477 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:06.033601 29328 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:06.033888 29328 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.034309 29328 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:06.036724 29477 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 3.
I20240502 08:19:06.037216 29366 leader_election.cc:302] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:19:06.037354 29328 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 3.
I20240502 08:19:06.037593 29620 raft_consensus.cc:2781] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:06.037909 29620 raft_consensus.cc:686] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:06.038182 29620 consensus_queue.cc:237] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.040781 29223 catalog_manager.cc:5484] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 2 to 3, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 3 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:06.159799 29540 raft_consensus.cc:979] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: : Instructing follower f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:06.159979 29540 raft_consensus.cc:1067] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Signalling peer f7462a6e2069459a94ad8bc917908dd7 to start an election
I20240502 08:19:06.160567 29403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
from {username='slave'} at 127.0.0.1:57608
I20240502 08:19:06.160740 29403 raft_consensus.cc:482] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:06.160879 29403 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:06.162961 29403 raft_consensus.cc:504] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.163573 29403 leader_election.cc:288] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:06.164011 29328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:06.164139 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "f7462a6e2069459a94ad8bc917908dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:06.164251 29328 raft_consensus.cc:3032] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:06.164273 29477 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:06.164374 29328 raft_consensus.cc:729] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:06.164682 29328 consensus_queue.cc:260] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.165067 29328 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:06.167299 29477 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:19:06.167701 29366 leader_election.cc:302] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7b2db66a24404ea5cf7dab9ef9fb78, f7462a6e2069459a94ad8bc917908dd7; no voters:
I20240502 08:19:06.167752 29328 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7462a6e2069459a94ad8bc917908dd7 in term 2.
I20240502 08:19:06.168011 29620 raft_consensus.cc:2781] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:06.168174 29620 raft_consensus.cc:686] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Leader. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:06.168438 29620 consensus_queue.cc:237] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:06.171064 29223 catalog_manager.cc:5484] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 reported cstate change: term changed from 1 to 2, leader changed from 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129) to f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130). New cstate: current_term: 2 leader_uuid: "f7462a6e2069459a94ad8bc917908dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:06.182452 29477 raft_consensus.cc:1261] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:06.183015 29620 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:06.187034 29328 raft_consensus.cc:1261] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:06.187680 29620 consensus_queue.cc:1035] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:06.211736 29328 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:06.212361 29622 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:06.216326 29477 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:06.216845 29622 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:06.282315 29477 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:06.282994 29622 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:06.286993 29326 raft_consensus.cc:1261] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:06.287837 29620 consensus_queue.cc:1035] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:06.526594 29326 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:06.527282 29641 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:06.531270 29477 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:06.531844 29622 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:06.632427 29326 raft_consensus.cc:1261] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:06.633039 29622 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:06.636471 29477 raft_consensus.cc:1261] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer f7462a6e2069459a94ad8bc917908dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:06.637003 29641 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:08.689030 29194 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240502 08:19:08.689303 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:08.691462 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:19:08.691684 29403 raft_consensus.cc:595] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:19:08.692674 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:19:08.692894 29403 raft_consensus.cc:595] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Received request to transfer leadership to TS 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:19:08.693744 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:19:08.693939 29403 raft_consensus.cc:595] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:19:08.694695 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:19:08.694870 29403 raft_consensus.cc:595] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Received request to transfer leadership to TS 246ac5ec788a4b3e80e6a724fc8c9860
I20240502 08:19:08.695786 29403 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac"
dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
mode: GRACEFUL
new_leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:54730
I20240502 08:19:08.695994 29403 raft_consensus.cc:595] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Received request to transfer leadership to TS 5f7b2db66a24404ea5cf7dab9ef9fb78
I20240502 08:19:08.696444 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240502 08:19:08.696672 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:08.763780 29647 raft_consensus.cc:979] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:08.764000 29647 raft_consensus.cc:1067] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:08.764814 29326 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56048
I20240502 08:19:08.765012 29326 raft_consensus.cc:482] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:08.765146 29326 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:08.767319 29326 raft_consensus.cc:504] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:08.768100 29326 leader_election.cc:288] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:08.768471 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:19:08.768596 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bedea97e364e1c96c53db623bc180d" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:08.768697 29403 raft_consensus.cc:3032] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:08.768738 29477 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:08.768793 29403 raft_consensus.cc:729] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:08.769080 29403 consensus_queue.cc:260] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:08.769461 29403 raft_consensus.cc:3037] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:08.771598 29477 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:19:08.772086 29291 leader_election.cc:302] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:19:08.772675 29648 raft_consensus.cc:2781] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:08.772758 29403 raft_consensus.cc:2454] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 2.
I20240502 08:19:08.773116 29648 raft_consensus.cc:686] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:08.773453 29648 consensus_queue.cc:237] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:08.775750 29222 catalog_manager.cc:5484] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 1 to 2, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:08.993934 29641 raft_consensus.cc:979] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:19:08.994201 29641 raft_consensus.cc:1067] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Signalling peer 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:19:08.994925 29477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:48610
I20240502 08:19:08.995149 29477 raft_consensus.cc:482] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:08.995272 29477 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:08.997449 29477 raft_consensus.cc:504] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:08.998296 29477 leader_election.cc:288] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 4 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:19:08.998854 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:08.998867 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77622c17b9284e17b0d292974ca2a3fd" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:19:08.999068 29326 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:08.999197 29403 raft_consensus.cc:3032] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:08.999300 29403 raft_consensus.cc:729] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:08.999641 29403 consensus_queue.cc:260] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:08.999979 29403 raft_consensus.cc:3037] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:09.001211 29326 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 4.
I20240502 08:19:09.001693 29442 leader_election.cc:302] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:19:09.002053 29621 raft_consensus.cc:2781] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:09.002195 29403 raft_consensus.cc:2454] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 4.
I20240502 08:19:09.002652 29621 raft_consensus.cc:686] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:19:09.003023 29621 consensus_queue.cc:237] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.005810 29222 catalog_manager.cc:5484] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 3 to 4, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 4 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:09.021639 29647 raft_consensus.cc:979] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:09.021826 29647 raft_consensus.cc:1067] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:09.022570 29326 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56048
I20240502 08:19:09.022795 29326 raft_consensus.cc:482] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:09.022922 29326 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:09.024825 29326 raft_consensus.cc:504] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.025492 29326 leader_election.cc:288] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 5 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:09.025889 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:19:09.025970 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0051a13be4f4bc3a6c00085a1d477fb" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:09.026074 29403 raft_consensus.cc:3032] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Stepping down as leader of term 4
I20240502 08:19:09.026173 29403 raft_consensus.cc:729] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:09.026191 29477 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:09.026468 29403 consensus_queue.cc:260] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.026773 29403 raft_consensus.cc:3037] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:09.028359 29477 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 5.
I20240502 08:19:09.028712 29403 raft_consensus.cc:2454] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 5.
I20240502 08:19:09.028750 29291 leader_election.cc:302] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:19:09.029073 29648 raft_consensus.cc:2781] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 5 FOLLOWER]: Leader election won for term 5
I20240502 08:19:09.029285 29648 raft_consensus.cc:686] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 5 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:09.029567 29648 consensus_queue.cc:237] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.032127 29222 catalog_manager.cc:5484] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 4 to 5, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 5 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:09.043956 29641 raft_consensus.cc:979] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:19:09.044183 29641 raft_consensus.cc:1067] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Signalling peer 5f7b2db66a24404ea5cf7dab9ef9fb78 to start an election
I20240502 08:19:09.044800 29477 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac"
dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
from {username='slave'} at 127.0.0.1:48610
I20240502 08:19:09.044983 29477 raft_consensus.cc:482] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:09.045066 29477 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.046984 29477 raft_consensus.cc:504] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.047569 29477 leader_election.cc:288] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Requested vote from peers 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193), f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687)
I20240502 08:19:09.048041 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:19:09.048051 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41120a5a34f487e80e9b7b654e6a8ac" candidate_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
I20240502 08:19:09.048323 29403 raft_consensus.cc:3032] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:09.048352 29326 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.048411 29403 raft_consensus.cc:729] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:09.048686 29403 consensus_queue.cc:260] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.049032 29403 raft_consensus.cc:3037] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.050524 29326 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:19:09.050881 29442 leader_election.cc:302] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:19:09.051119 29621 raft_consensus.cc:2781] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:09.051091 29403 raft_consensus.cc:2454] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7b2db66a24404ea5cf7dab9ef9fb78 in term 3.
I20240502 08:19:09.051306 29621 raft_consensus.cc:686] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7b2db66a24404ea5cf7dab9ef9fb78, State: Running, Role: LEADER
I20240502 08:19:09.051585 29621 consensus_queue.cc:237] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.053925 29222 catalog_manager.cc:5484] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 reported cstate change: term changed from 2 to 3, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131). New cstate: current_term: 3 leader_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:09.142560 29647 raft_consensus.cc:979] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: : Instructing follower 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:09.142777 29647 raft_consensus.cc:1067] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Signalling peer 246ac5ec788a4b3e80e6a724fc8c9860 to start an election
I20240502 08:19:09.143467 29326 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270"
dest_uuid: "246ac5ec788a4b3e80e6a724fc8c9860"
from {username='slave'} at 127.0.0.1:56048
I20240502 08:19:09.143684 29326 raft_consensus.cc:482] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:09.143810 29326 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.145689 29326 raft_consensus.cc:504] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.146240 29326 leader_election.cc:288] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 3 election: Requested vote from peers f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130:38687), 5f7b2db66a24404ea5cf7dab9ef9fb78 (127.28.130.131:37023)
I20240502 08:19:09.146637 29403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7462a6e2069459a94ad8bc917908dd7"
I20240502 08:19:09.146674 29477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a9707d186f04bee9883097bdf76f270" candidate_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78"
I20240502 08:19:09.146812 29403 raft_consensus.cc:3032] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:09.146867 29477 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.146883 29403 raft_consensus.cc:729] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7462a6e2069459a94ad8bc917908dd7, State: Running, Role: LEADER
I20240502 08:19:09.147089 29403 consensus_queue.cc:260] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.147409 29403 raft_consensus.cc:3037] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:09.149036 29477 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 3.
I20240502 08:19:09.149366 29403 raft_consensus.cc:2454] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246ac5ec788a4b3e80e6a724fc8c9860 in term 3.
I20240502 08:19:09.149394 29291 leader_election.cc:302] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 246ac5ec788a4b3e80e6a724fc8c9860, 5f7b2db66a24404ea5cf7dab9ef9fb78; no voters:
I20240502 08:19:09.149688 29648 raft_consensus.cc:2781] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:09.149859 29648 raft_consensus.cc:686] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 LEADER]: Becoming Leader. State: Replica: 246ac5ec788a4b3e80e6a724fc8c9860, State: Running, Role: LEADER
I20240502 08:19:09.150120 29648 consensus_queue.cc:237] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } }
I20240502 08:19:09.152565 29222 catalog_manager.cc:5484] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 reported cstate change: term changed from 2 to 3, leader changed from f7462a6e2069459a94ad8bc917908dd7 (127.28.130.130) to 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129). New cstate: current_term: 3 leader_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:09.199975 29403 raft_consensus.cc:1261] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:09.200609 29648 consensus_queue.cc:1035] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:09.204778 29477 raft_consensus.cc:1261] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:09.205701 29649 consensus_queue.cc:1035] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:09.437072 29403 raft_consensus.cc:1261] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:09.437647 29655 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:09.441855 29326 raft_consensus.cc:1261] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:09.442458 29655 consensus_queue.cc:1035] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:09.462239 29403 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 5 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 08:19:09.462848 29648 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 08:19:09.466629 29477 raft_consensus.cc:1261] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 5 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 08:19:09.467235 29670 consensus_queue.cc:1035] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 08:19:09.500638 29403 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:09.501403 29655 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:09.505630 29326 raft_consensus.cc:1261] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Refusing update from remote peer 5f7b2db66a24404ea5cf7dab9ef9fb78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:09.506225 29655 consensus_queue.cc:1035] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246ac5ec788a4b3e80e6a724fc8c9860" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 33193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:09.606535 29477 raft_consensus.cc:1261] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:09.607192 29670 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7b2db66a24404ea5cf7dab9ef9fb78" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:09.611775 29403 raft_consensus.cc:1261] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Refusing update from remote peer 246ac5ec788a4b3e80e6a724fc8c9860: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:09.612562 29670 consensus_queue.cc:1035] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7462a6e2069459a94ad8bc917908dd7" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:09.697237 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:09.698936 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:09.699133 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:10.699579 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:10.701071 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:10.701239 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:11.701704 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:11.703418 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:11.703626 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:12.704046 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:12.705673 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:12.705833 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:13.706243 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:13.707777 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:13.707986 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:14.708468 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:14.710081 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:14.710345 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:15.710808 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:15.712445 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:15.712632 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:16.718587 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:16.720237 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:16.720415 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:17.725610 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:17.727205 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:17.727378 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:18.737011 29194 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240502 08:19:18.737303 29194 tablet_server.cc:178] TabletServer@127.28.130.129:0 shutting down...
I20240502 08:19:18.749007 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:18.749347 29194 tablet_replica.cc:330] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.749779 29194 raft_consensus.cc:2229] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.750236 29194 raft_consensus.cc:2258] T 95bedea97e364e1c96c53db623bc180d P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.751524 29194 tablet_replica.cc:330] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.751706 29194 raft_consensus.cc:2229] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.751875 29194 raft_consensus.cc:2258] T da3d6325fb104d348d00d4b79e80ff20 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.752401 29194 tablet_replica.cc:330] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.752543 29194 raft_consensus.cc:2229] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.752696 29194 raft_consensus.cc:2258] T a42284fd5443489ca0cb096229c68def P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.753098 29194 tablet_replica.cc:330] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.753250 29194 raft_consensus.cc:2229] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 5 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.753568 29194 raft_consensus.cc:2258] T d0051a13be4f4bc3a6c00085a1d477fb P 246ac5ec788a4b3e80e6a724fc8c9860 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.754005 29194 tablet_replica.cc:330] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.754145 29194 raft_consensus.cc:2229] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.754299 29194 raft_consensus.cc:2258] T 99857059fc594eba99ba397d7365ce27 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.754817 29194 tablet_replica.cc:330] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.754974 29194 raft_consensus.cc:2229] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.755113 29194 raft_consensus.cc:2258] T 77622c17b9284e17b0d292974ca2a3fd P 246ac5ec788a4b3e80e6a724fc8c9860 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.755513 29194 tablet_replica.cc:330] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.755647 29194 raft_consensus.cc:2229] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.755949 29194 raft_consensus.cc:2258] T 2a9707d186f04bee9883097bdf76f270 P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.756345 29194 tablet_replica.cc:330] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.756485 29194 raft_consensus.cc:2229] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.756616 29194 raft_consensus.cc:2258] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.757018 29194 tablet_replica.cc:330] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860: stopping tablet replica
I20240502 08:19:18.757155 29194 raft_consensus.cc:2229] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.757306 29194 raft_consensus.cc:2258] T e41120a5a34f487e80e9b7b654e6a8ac P 246ac5ec788a4b3e80e6a724fc8c9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.774080 29194 tablet_server.cc:194] TabletServer@127.28.130.129:0 shutdown complete.
W20240502 08:19:18.780714 29442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.130.129:33193: connect: Connection refused (error 111)
I20240502 08:19:18.781515 29194 tablet_server.cc:178] TabletServer@127.28.130.130:0 shutting down...
W20240502 08:19:18.782264 29442 consensus_peers.cc:485] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 -> Peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Couldn't send request to peer 246ac5ec788a4b3e80e6a724fc8c9860. Status: Network error: Client connection negotiation failed: client connection to 127.28.130.129:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 08:19:18.788240 29368 consensus_peers.cc:485] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 -> Peer 246ac5ec788a4b3e80e6a724fc8c9860 (127.28.130.129:33193): Couldn't send request to peer 246ac5ec788a4b3e80e6a724fc8c9860. Status: Network error: Client connection negotiation failed: client connection to 127.28.130.129:33193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:18.792884 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:18.793174 29194 tablet_replica.cc:330] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.793390 29194 raft_consensus.cc:2229] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.793730 29194 raft_consensus.cc:2258] T a42284fd5443489ca0cb096229c68def P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.794329 29194 tablet_replica.cc:330] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.794544 29194 raft_consensus.cc:2229] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.794719 29194 raft_consensus.cc:2258] T 99857059fc594eba99ba397d7365ce27 P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.795202 29194 tablet_replica.cc:330] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.795348 29194 raft_consensus.cc:2229] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.795501 29194 raft_consensus.cc:2258] T e41120a5a34f487e80e9b7b654e6a8ac P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.795910 29194 tablet_replica.cc:330] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.796062 29194 raft_consensus.cc:2229] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 3 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.796322 29194 raft_consensus.cc:2258] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.796731 29194 tablet_replica.cc:330] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.796864 29194 raft_consensus.cc:2229] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.797008 29194 raft_consensus.cc:2258] T 77622c17b9284e17b0d292974ca2a3fd P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.797417 29194 tablet_replica.cc:330] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.797560 29194 raft_consensus.cc:2229] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.797683 29194 raft_consensus.cc:2258] T 2a9707d186f04bee9883097bdf76f270 P f7462a6e2069459a94ad8bc917908dd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.798079 29194 tablet_replica.cc:330] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.798228 29194 raft_consensus.cc:2229] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.798403 29194 raft_consensus.cc:2258] T 95bedea97e364e1c96c53db623bc180d P f7462a6e2069459a94ad8bc917908dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.798781 29194 tablet_replica.cc:330] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.798919 29194 raft_consensus.cc:2229] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 4 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.799188 29194 raft_consensus.cc:2258] T da3d6325fb104d348d00d4b79e80ff20 P f7462a6e2069459a94ad8bc917908dd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.799584 29194 tablet_replica.cc:330] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7: stopping tablet replica
I20240502 08:19:18.799713 29194 raft_consensus.cc:2229] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.799860 29194 raft_consensus.cc:2258] T d0051a13be4f4bc3a6c00085a1d477fb P f7462a6e2069459a94ad8bc917908dd7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.815588 29194 tablet_server.cc:194] TabletServer@127.28.130.130:0 shutdown complete.
I20240502 08:19:18.819669 29194 tablet_server.cc:178] TabletServer@127.28.130.131:0 shutting down...
I20240502 08:19:18.829169 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:18.829452 29194 tablet_replica.cc:330] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.829640 29194 raft_consensus.cc:2229] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.829988 29194 raft_consensus.cc:2258] T 99857059fc594eba99ba397d7365ce27 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.830612 29194 tablet_replica.cc:330] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.830775 29194 raft_consensus.cc:2229] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.830926 29194 raft_consensus.cc:2258] T a42284fd5443489ca0cb096229c68def P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.831425 29194 tablet_replica.cc:330] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.831557 29194 raft_consensus.cc:2229] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.831701 29194 raft_consensus.cc:2258] T d0051a13be4f4bc3a6c00085a1d477fb P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.832110 29194 tablet_replica.cc:330] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.832264 29194 raft_consensus.cc:2229] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.832405 29194 raft_consensus.cc:2258] T 3ac71ee46eb04edfb13b1c24bf0f2c9c P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.832798 29194 tablet_replica.cc:330] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.832929 29194 raft_consensus.cc:2229] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.833072 29194 raft_consensus.cc:2258] T da3d6325fb104d348d00d4b79e80ff20 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.833442 29194 tablet_replica.cc:330] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.833614 29194 raft_consensus.cc:2229] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.833751 29194 raft_consensus.cc:2258] T 95bedea97e364e1c96c53db623bc180d P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.834146 29194 tablet_replica.cc:330] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.834280 29194 raft_consensus.cc:2229] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.834578 29194 raft_consensus.cc:2258] T e41120a5a34f487e80e9b7b654e6a8ac P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.834980 29194 tablet_replica.cc:330] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.835127 29194 raft_consensus.cc:2229] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:18.835270 29194 raft_consensus.cc:2258] T 2a9707d186f04bee9883097bdf76f270 P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.835656 29194 tablet_replica.cc:330] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78: stopping tablet replica
I20240502 08:19:18.835788 29194 raft_consensus.cc:2229] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.836040 29194 raft_consensus.cc:2258] T 77622c17b9284e17b0d292974ca2a3fd P 5f7b2db66a24404ea5cf7dab9ef9fb78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.852092 29194 tablet_server.cc:194] TabletServer@127.28.130.131:0 shutdown complete.
I20240502 08:19:18.857021 29194 master.cc:537] Master@127.28.130.190:35317 shutting down...
I20240502 08:19:18.867568 29194 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 1 LEADER]: Raft consensus shutting down.
I20240502 08:19:18.867929 29194 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:18.868110 29194 tablet_replica.cc:330] T 00000000000000000000000000000000 P 063eefa22bfc407b871e16366ab9c0c0: stopping tablet replica
I20240502 08:19:18.883163 29194 master.cc:552] Master@127.28.130.190:35317 shutdown complete.
246ac5ec788a4b3e80e6a724fc8c9860 4
5f7b2db66a24404ea5cf7dab9ef9fb78 1
f7462a6e2069459a94ad8bc917908dd7 4
246ac5ec788a4b3e80e6a724fc8c9860 3
5f7b2db66a24404ea5cf7dab9ef9fb78 3
f7462a6e2069459a94ad8bc917908dd7 3
246ac5ec788a4b3e80e6a724fc8c9860 0
5f7b2db66a24404ea5cf7dab9ef9fb78 1
f7462a6e2069459a94ad8bc917908dd7 8
246ac5ec788a4b3e80e6a724fc8c9860 3
5f7b2db66a24404ea5cf7dab9ef9fb78 3
f7462a6e2069459a94ad8bc917908dd7 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27576 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240502 08:19:18.902786 29194 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.130.190:42931
I20240502 08:19:18.903370 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:18.906636 29686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:18.907305 29194 server_base.cc:1034] running on GCE node
W20240502 08:19:18.907795 29687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:18.908322 29689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:18.908699 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:18.908771 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:18.908825 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637958908800 us; error 0 us; skew 500 ppm
I20240502 08:19:18.908959 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:18.910208 29194 webserver.cc:460] Webserver started at http://127.28.130.190:33895/ using document root <none> and password file <none>
I20240502 08:19:18.910472 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:18.910565 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:18.910674 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:18.911368 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/master-0-root/instance:
uuid: "16b251ef8ca641f182b59763e6884dac"
format_stamp: "Formatted at 2024-05-02 08:19:18 on dist-test-slave-330p"
I20240502 08:19:18.913839 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 08:19:18.915588 29694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:18.915926 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:18.916040 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/master-0-root
uuid: "16b251ef8ca641f182b59763e6884dac"
format_stamp: "Formatted at 2024-05-02 08:19:18 on dist-test-slave-330p"
I20240502 08:19:18.916215 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:18.923151 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:18.923813 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:18.938329 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.190:42931
I20240502 08:19:18.938387 29745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.190:42931 every 8 connection(s)
I20240502 08:19:18.939782 29746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:18.943841 29746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac: Bootstrap starting.
I20240502 08:19:18.945127 29746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:18.946756 29746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac: No bootstrap required, opened a new log
I20240502 08:19:18.947366 29746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER }
I20240502 08:19:18.947499 29746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:18.947568 29746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b251ef8ca641f182b59763e6884dac, State: Initialized, Role: FOLLOWER
I20240502 08:19:18.947772 29746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER }
I20240502 08:19:18.947911 29746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:19:18.947968 29746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:19:18.948045 29746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:18.949751 29746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER }
I20240502 08:19:18.949956 29746 leader_election.cc:302] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16b251ef8ca641f182b59763e6884dac; no voters:
I20240502 08:19:18.950335 29746 leader_election.cc:288] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 08:19:18.950529 29749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:18.951103 29749 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 1 LEADER]: Becoming Leader. State: Replica: 16b251ef8ca641f182b59763e6884dac, State: Running, Role: LEADER
I20240502 08:19:18.951375 29746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [sys.catalog]: configured and running, proceeding with master startup.
I20240502 08:19:18.951391 29749 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER }
I20240502 08:19:18.952741 29751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16b251ef8ca641f182b59763e6884dac. Latest consensus state: current_term: 1 leader_uuid: "16b251ef8ca641f182b59763e6884dac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER } }
I20240502 08:19:18.952932 29751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [sys.catalog]: This master's current role is: LEADER
I20240502 08:19:18.952831 29750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16b251ef8ca641f182b59763e6884dac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b251ef8ca641f182b59763e6884dac" member_type: VOTER } }
I20240502 08:19:18.953059 29750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [sys.catalog]: This master's current role is: LEADER
I20240502 08:19:18.953860 29755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 08:19:18.955753 29755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 08:19:18.957226 29194 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 08:19:18.958642 29755 catalog_manager.cc:1347] Generated new cluster ID: 83ffca987f424f1190f4081ced01a6fa
I20240502 08:19:18.958736 29755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 08:19:18.988654 29755 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 08:19:18.989457 29755 catalog_manager.cc:1504] Loading token signing keys...
I20240502 08:19:18.995894 29755 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac: Generated new TSK 0
I20240502 08:19:18.996143 29755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 08:19:19.022643 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:19.026105 29767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:19.026732 29768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:19.027479 29194 server_base.cc:1034] running on GCE node
W20240502 08:19:19.028002 29770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:19.028396 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:19.028481 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:19.028548 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637959028523 us; error 0 us; skew 500 ppm
I20240502 08:19:19.028712 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:19.030031 29194 webserver.cc:460] Webserver started at http://127.28.130.129:45299/ using document root <none> and password file <none>
I20240502 08:19:19.030308 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:19.030423 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:19.030577 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:19.031293 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-0-root/instance:
uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.033891 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:19.035602 29775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.035940 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:19.036072 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.036211 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:19.053411 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:19.054064 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:19.054765 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:19.055781 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:19.055877 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.055989 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:19.056066 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.072587 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.129:46527
I20240502 08:19:19.072621 29838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.129:46527 every 8 connection(s)
I20240502 08:19:19.074393 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:19.078054 29843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:19.078691 29844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:19.079094 29846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:19.079936 29194 server_base.cc:1034] running on GCE node
I20240502 08:19:19.080307 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:19.080403 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:19.080487 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637959080450 us; error 0 us; skew 500 ppm
I20240502 08:19:19.080696 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:19.082324 29194 webserver.cc:460] Webserver started at http://127.28.130.130:36295/ using document root <none> and password file <none>
I20240502 08:19:19.082413 29839 heartbeater.cc:347] Connected to a master server at 127.28.130.190:42931
I20240502 08:19:19.082571 29839 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:19.082621 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:19.082751 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:19.082887 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:19.083060 29839 heartbeater.cc:511] Master 127.28.130.190:42931 requested a full tablet report, sending...
I20240502 08:19:19.083673 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-1-root/instance:
uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.084089 29711 ts_manager.cc:194] Registered new tserver with Master: 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527)
I20240502 08:19:19.085191 29711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57778
I20240502 08:19:19.086602 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 08:19:19.088255 29851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.088645 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:19.088753 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.088879 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:19.101121 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:19.101795 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:19.102417 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:19.103296 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:19.103364 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.103453 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:19.103498 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.117318 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.130:34523
I20240502 08:19:19.117381 29913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.130:34523 every 8 connection(s)
I20240502 08:19:19.119181 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:19.122907 29918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:19.123533 29917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:19.124136 29194 server_base.cc:1034] running on GCE node
W20240502 08:19:19.124565 29920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:19.124976 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:19.125080 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:19.125155 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637959125127 us; error 0 us; skew 500 ppm
I20240502 08:19:19.125389 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:19.127050 29914 heartbeater.cc:347] Connected to a master server at 127.28.130.190:42931
I20240502 08:19:19.127228 29914 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:19.127287 29194 webserver.cc:460] Webserver started at http://127.28.130.131:37763/ using document root <none> and password file <none>
I20240502 08:19:19.127614 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:19.127677 29914 heartbeater.cc:511] Master 127.28.130.190:42931 requested a full tablet report, sending...
I20240502 08:19:19.127717 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:19.127892 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:19.128662 29711 ts_manager.cc:194] Registered new tserver with Master: 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.128698 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-2-root/instance:
uuid: "4190214649a04a5faf09ab13f99d2d26"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.129503 29711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57780
I20240502 08:19:19.131647 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:19.133337 29925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.133728 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:19.133848 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
uuid: "4190214649a04a5faf09ab13f99d2d26"
format_stamp: "Formatted at 2024-05-02 08:19:19 on dist-test-slave-330p"
I20240502 08:19:19.133958 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714637931256210-29194-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:19.148816 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:19.149439 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:19.150022 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:19.150972 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:19.151095 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.151202 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:19.151278 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:19.167085 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.131:43099
I20240502 08:19:19.167127 29987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.131:43099 every 8 connection(s)
I20240502 08:19:19.174001 29988 heartbeater.cc:347] Connected to a master server at 127.28.130.190:42931
I20240502 08:19:19.174144 29988 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:19.174564 29988 heartbeater.cc:511] Master 127.28.130.190:42931 requested a full tablet report, sending...
I20240502 08:19:19.175421 29711 ts_manager.cc:194] Registered new tserver with Master: 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.176057 29194 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007965827s
I20240502 08:19:19.176337 29711 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57792
I20240502 08:19:19.177278 29194 test_util.cc:268] Using random seed: 1115268135
I20240502 08:19:19.189270 29711 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57808:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 08:19:19.190135 29711 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 08:19:19.221032 29804 tablet_service.cc:1467] Processing CreateTablet for tablet d082e87c880045e28770926b5d56d1fd (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 08:19:19.221099 29879 tablet_service.cc:1467] Processing CreateTablet for tablet d082e87c880045e28770926b5d56d1fd (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 08:19:19.221735 29804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d082e87c880045e28770926b5d56d1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.221730 29879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d082e87c880045e28770926b5d56d1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.222048 29803 tablet_service.cc:1467] Processing CreateTablet for tablet 66c0f287a1e0407c8b2a91c733c87f80 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 08:19:19.222558 29803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c0f287a1e0407c8b2a91c733c87f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.224325 29800 tablet_service.cc:1467] Processing CreateTablet for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 08:19:19.224840 29800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.226902 29801 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3765d2d56044db805b3200fd38d838 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 08:19:19.227425 29801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3765d2d56044db805b3200fd38d838. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.229503 30003 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.229668 29878 tablet_service.cc:1467] Processing CreateTablet for tablet 66c0f287a1e0407c8b2a91c733c87f80 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 08:19:19.230224 29878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c0f287a1e0407c8b2a91c733c87f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.230688 29799 tablet_service.cc:1467] Processing CreateTablet for tablet c39aa0008e8d4a5b809f8c6a03a061e2 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 08:19:19.230882 29797 tablet_service.cc:1467] Processing CreateTablet for tablet 6d28cad0c8cf489f839f14b65b59dc51 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 08:19:19.231160 29799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39aa0008e8d4a5b809f8c6a03a061e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.231389 29797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d28cad0c8cf489f839f14b65b59dc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.231735 30003 tablet_bootstrap.cc:654] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.236126 29795 tablet_service.cc:1467] Processing CreateTablet for tablet 46e6424227c94031ae73aad1665b9711 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 08:19:19.236392 29796 tablet_service.cc:1467] Processing CreateTablet for tablet 777ff69ba93f4d17a207e0a91385976c (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 08:19:19.241463 29795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e6424227c94031ae73aad1665b9711. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.238598 29794 tablet_service.cc:1467] Processing CreateTablet for tablet c05672c324e343a5b47ed0e202b146fe (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 08:19:19.238430 29798 tablet_service.cc:1467] Processing CreateTablet for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 08:19:19.246024 29879 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3765d2d56044db805b3200fd38d838 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 08:19:19.248751 29796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777ff69ba93f4d17a207e0a91385976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.248615 29952 tablet_service.cc:1467] Processing CreateTablet for tablet 66c0f287a1e0407c8b2a91c733c87f80 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 08:19:19.244319 29953 tablet_service.cc:1467] Processing CreateTablet for tablet d082e87c880045e28770926b5d56d1fd (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 08:19:19.251339 29879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3765d2d56044db805b3200fd38d838. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.252743 29794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05672c324e343a5b47ed0e202b146fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.252422 29877 tablet_service.cc:1467] Processing CreateTablet for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 08:19:19.252308 29875 tablet_service.cc:1467] Processing CreateTablet for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 08:19:19.257117 29798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.257615 29874 tablet_service.cc:1467] Processing CreateTablet for tablet 6d28cad0c8cf489f839f14b65b59dc51 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 08:19:19.258052 29873 tablet_service.cc:1467] Processing CreateTablet for tablet 777ff69ba93f4d17a207e0a91385976c (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 08:19:19.258769 29872 tablet_service.cc:1467] Processing CreateTablet for tablet 46e6424227c94031ae73aad1665b9711 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 08:19:19.259584 29951 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3765d2d56044db805b3200fd38d838 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 08:19:19.262135 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c0f287a1e0407c8b2a91c733c87f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.261250 29876 tablet_service.cc:1467] Processing CreateTablet for tablet c39aa0008e8d4a5b809f8c6a03a061e2 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 08:19:19.266908 29953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d082e87c880045e28770926b5d56d1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.267678 29877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.266780 29950 tablet_service.cc:1467] Processing CreateTablet for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 08:19:19.267689 29949 tablet_service.cc:1467] Processing CreateTablet for tablet c39aa0008e8d4a5b809f8c6a03a061e2 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 08:19:19.272434 29875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.273823 30003 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.271893 29947 tablet_service.cc:1467] Processing CreateTablet for tablet 6d28cad0c8cf489f839f14b65b59dc51 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 08:19:19.274008 30003 ts_tablet_manager.cc:1367] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.007s
I20240502 08:19:19.274966 29951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3765d2d56044db805b3200fd38d838. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.275645 29874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d28cad0c8cf489f839f14b65b59dc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.276552 29949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39aa0008e8d4a5b809f8c6a03a061e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.276787 29947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d28cad0c8cf489f839f14b65b59dc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.274158 29948 tablet_service.cc:1467] Processing CreateTablet for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 08:19:19.279314 29873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777ff69ba93f4d17a207e0a91385976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.280086 29950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d58f4d9d5a4809a3b4a1b0a0c4baaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.279420 29945 tablet_service.cc:1467] Processing CreateTablet for tablet 46e6424227c94031ae73aad1665b9711 (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 08:19:19.282872 30004 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.278091 29946 tablet_service.cc:1467] Processing CreateTablet for tablet 777ff69ba93f4d17a207e0a91385976c (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 08:19:19.280516 29871 tablet_service.cc:1467] Processing CreateTablet for tablet c05672c324e343a5b47ed0e202b146fe (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 08:19:19.286710 29876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39aa0008e8d4a5b809f8c6a03a061e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.282985 29944 tablet_service.cc:1467] Processing CreateTablet for tablet c05672c324e343a5b47ed0e202b146fe (DEFAULT_TABLE table=test-workload [id=4cff05f8d700460ca205d686fca5e632]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 08:19:19.292294 29946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 777ff69ba93f4d17a207e0a91385976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.292228 30003 raft_consensus.cc:348] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.293135 29872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e6424227c94031ae73aad1665b9711. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.295341 29871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05672c324e343a5b47ed0e202b146fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.296411 30003 raft_consensus.cc:374] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.298635 29944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05672c324e343a5b47ed0e202b146fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.302418 29945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e6424227c94031ae73aad1665b9711. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.304769 30003 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.305266 29948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12ebbb3d6c6c40a8b3f597f5ea802f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:19.306264 30003 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.311089 30004 tablet_bootstrap.cc:654] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.351455 30003 ts_tablet_manager.cc:1398] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.072s user 0.015s sys 0.023s
I20240502 08:19:19.353827 29914 heartbeater.cc:503] Master 127.28.130.190:42931 was elected leader, sending a full tablet report...
I20240502 08:19:19.356112 30003 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.381989 30004 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.384568 30004 ts_tablet_manager.cc:1367] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.112s user 0.011s sys 0.014s
I20240502 08:19:19.389467 30004 raft_consensus.cc:348] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.389956 30008 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.391557 30004 raft_consensus.cc:374] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.392334 30004 raft_consensus.cc:729] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.393764 30003 tablet_bootstrap.cc:654] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.394783 30004 consensus_queue.cc:260] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.398901 29839 heartbeater.cc:503] Master 127.28.130.190:42931 was elected leader, sending a full tablet report...
I20240502 08:19:19.398927 30004 ts_tablet_manager.cc:1398] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20240502 08:19:19.399526 30004 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.401312 30004 tablet_bootstrap.cc:654] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.406869 30008 tablet_bootstrap.cc:654] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.407150 30004 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.407356 30004 ts_tablet_manager.cc:1367] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20240502 08:19:19.408025 30004 raft_consensus.cc:348] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.408347 30004 raft_consensus.cc:374] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.408453 30004 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.408723 30004 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.409166 30004 ts_tablet_manager.cc:1398] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:19.409375 30008 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.409591 30008 ts_tablet_manager.cc:1367] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20240502 08:19:19.409991 30003 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.410164 30003 ts_tablet_manager.cc:1367] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.004s
I20240502 08:19:19.410493 30008 raft_consensus.cc:348] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.410717 30008 raft_consensus.cc:374] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.410835 30008 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.410974 30003 raft_consensus.cc:348] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.411190 30003 raft_consensus.cc:374] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.411273 30003 raft_consensus.cc:729] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.411120 30008 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.411512 30003 consensus_queue.cc:260] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.412068 30003 ts_tablet_manager.cc:1398] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:19.412374 30003 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.409423 30004 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.414269 30003 tablet_bootstrap.cc:654] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.415113 30004 tablet_bootstrap.cc:654] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.421591 29988 heartbeater.cc:503] Master 127.28.130.190:42931 was elected leader, sending a full tablet report...
I20240502 08:19:19.421870 30008 ts_tablet_manager.cc:1398] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.012s user 0.004s sys 0.007s
I20240502 08:19:19.422221 30008 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.424225 30008 tablet_bootstrap.cc:654] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.426919 30003 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.427119 30003 ts_tablet_manager.cc:1367] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20240502 08:19:19.427261 30004 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.427429 30004 ts_tablet_manager.cc:1367] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.006s
I20240502 08:19:19.428292 30004 raft_consensus.cc:348] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.428354 30003 raft_consensus.cc:348] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.428534 30004 raft_consensus.cc:374] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.428597 30003 raft_consensus.cc:374] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.428655 30004 raft_consensus.cc:729] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.428721 30003 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.429061 30003 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.429992 30004 consensus_queue.cc:260] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.430276 30003 ts_tablet_manager.cc:1398] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:19.430765 30004 ts_tablet_manager.cc:1398] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:19.430894 30003 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.431072 30004 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.433043 30004 tablet_bootstrap.cc:654] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.433382 30003 tablet_bootstrap.cc:654] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.441864 30008 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.442243 30008 ts_tablet_manager.cc:1367] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.001s
I20240502 08:19:19.442494 30003 tablet_bootstrap.cc:492] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.442690 30003 ts_tablet_manager.cc:1367] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20240502 08:19:19.442904 30004 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.443081 30004 ts_tablet_manager.cc:1367] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.001s
I20240502 08:19:19.443349 30003 raft_consensus.cc:348] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.443348 30008 raft_consensus.cc:348] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.443665 30003 raft_consensus.cc:374] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.443691 30008 raft_consensus.cc:374] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.443809 30003 raft_consensus.cc:729] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.443742 30004 raft_consensus.cc:348] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.443994 30004 raft_consensus.cc:374] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.443812 30008 raft_consensus.cc:729] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.444074 30004 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.444397 30004 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.444293 30003 consensus_queue.cc:260] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.444294 30008 consensus_queue.cc:260] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.444983 30004 ts_tablet_manager.cc:1398] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:19.445425 30004 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.445843 30003 ts_tablet_manager.cc:1398] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:19.446161 30003 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.447163 30008 ts_tablet_manager.cc:1398] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 08:19:19.447373 30004 tablet_bootstrap.cc:654] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.447511 30008 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.448221 30003 tablet_bootstrap.cc:654] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.449242 30008 tablet_bootstrap.cc:654] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.455654 30004 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.455873 30004 ts_tablet_manager.cc:1367] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240502 08:19:19.456792 30004 raft_consensus.cc:348] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.457064 30004 raft_consensus.cc:374] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.457171 30004 raft_consensus.cc:729] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.457454 30004 consensus_queue.cc:260] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.458031 30008 tablet_bootstrap.cc:492] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.458155 30004 ts_tablet_manager.cc:1398] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:19.458233 30008 ts_tablet_manager.cc:1367] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20240502 08:19:19.458460 30004 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.459372 30008 raft_consensus.cc:348] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.459707 30008 raft_consensus.cc:374] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.459846 30008 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.460410 30004 tablet_bootstrap.cc:654] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.460242 30008 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.462154 30008 ts_tablet_manager.cc:1398] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:19.462529 30008 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.462872 30003 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.463014 30003 ts_tablet_manager.cc:1367] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.009s
I20240502 08:19:19.463110 30004 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.463299 30004 ts_tablet_manager.cc:1367] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 08:19:19.463965 30003 raft_consensus.cc:348] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.464102 30004 raft_consensus.cc:348] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.464215 30003 raft_consensus.cc:374] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.464370 30004 raft_consensus.cc:374] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.464449 30008 tablet_bootstrap.cc:654] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.464391 30003 raft_consensus.cc:729] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.464486 30004 raft_consensus.cc:729] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.464740 30003 consensus_queue.cc:260] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.464859 30004 consensus_queue.cc:260] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.465498 30004 ts_tablet_manager.cc:1398] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 08:19:19.465503 30003 ts_tablet_manager.cc:1398] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:19.465823 30004 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.466573 30003 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.468744 30004 tablet_bootstrap.cc:654] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.470779 30003 tablet_bootstrap.cc:654] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.471571 30004 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.471757 30004 ts_tablet_manager.cc:1367] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 08:19:19.472594 30008 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.472546 30004 raft_consensus.cc:348] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.472800 30003 tablet_bootstrap.cc:492] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.472766 30004 raft_consensus.cc:374] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.472770 30008 ts_tablet_manager.cc:1367] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.007s
I20240502 08:19:19.472921 30004 raft_consensus.cc:729] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.472985 30003 ts_tablet_manager.cc:1367] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240502 08:19:19.473194 30004 consensus_queue.cc:260] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.473511 30008 raft_consensus.cc:348] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.473759 30008 raft_consensus.cc:374] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.473788 30004 ts_tablet_manager.cc:1398] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:19.473850 30008 raft_consensus.cc:729] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.473870 30003 raft_consensus.cc:348] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.474097 30004 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.474068 30003 raft_consensus.cc:374] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.474174 30003 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.474123 30008 consensus_queue.cc:260] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.474505 30003 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.474723 30008 ts_tablet_manager.cc:1398] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:19.475678 30008 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.475836 30004 tablet_bootstrap.cc:654] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.477344 30008 tablet_bootstrap.cc:654] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.478744 30003 ts_tablet_manager.cc:1398] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 08:19:19.480674 30003 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.483246 30003 tablet_bootstrap.cc:654] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.484635 30004 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.484833 30004 ts_tablet_manager.cc:1367] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240502 08:19:19.485024 30008 tablet_bootstrap.cc:492] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.485239 30008 ts_tablet_manager.cc:1367] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20240502 08:19:19.485648 30004 raft_consensus.cc:348] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.485875 30004 raft_consensus.cc:374] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.485965 30004 raft_consensus.cc:729] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.486318 30009 raft_consensus.cc:482] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.486269 30004 consensus_queue.cc:260] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.486382 30008 raft_consensus.cc:348] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.486668 30008 raft_consensus.cc:374] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.486500 30009 raft_consensus.cc:504] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.486806 30008 raft_consensus.cc:729] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.487162 30008 consensus_queue.cc:260] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.487879 30009 leader_election.cc:288] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.490449 30008 ts_tablet_manager.cc:1398] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20240502 08:19:19.491573 30008 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.493607 30008 tablet_bootstrap.cc:654] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.495606 30006 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.495831 30006 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.497277 30006 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.505817 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c0f287a1e0407c8b2a91c733c87f80" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.506335 29889 raft_consensus.cc:2454] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 0.
I20240502 08:19:19.508899 30004 ts_tablet_manager.cc:1398] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.024s user 0.008s sys 0.016s
I20240502 08:19:19.509346 30004 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.511457 30004 tablet_bootstrap.cc:654] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.512277 29777 leader_election.cc:302] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.513761 30029 raft_consensus.cc:2781] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.514046 30029 raft_consensus.cc:482] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.514320 30029 raft_consensus.cc:3037] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.519415 30029 raft_consensus.cc:504] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.521414 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c0f287a1e0407c8b2a91c733c87f80" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.521747 29889 raft_consensus.cc:3037] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.508255 30003 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.528158 30003 ts_tablet_manager.cc:1367] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.002s
I20240502 08:19:19.529585 30003 raft_consensus.cc:348] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.530148 30003 raft_consensus.cc:374] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.530364 30003 raft_consensus.cc:729] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.526254 29889 raft_consensus.cc:2454] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.531386 29777 leader_election.cc:302] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.531860 30009 raft_consensus.cc:2781] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.537338 30003 consensus_queue.cc:260] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.538973 30003 ts_tablet_manager.cc:1398] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240502 08:19:19.540732 30003 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.544153 30003 tablet_bootstrap.cc:654] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.547825 30004 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.541117 30029 leader_election.cc:288] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.548024 30004 ts_tablet_manager.cc:1367] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.031s
I20240502 08:19:19.548944 30004 raft_consensus.cc:348] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.549201 30004 raft_consensus.cc:374] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.549335 30004 raft_consensus.cc:729] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.549763 30004 consensus_queue.cc:260] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.550379 30004 ts_tablet_manager.cc:1398] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:19.550763 30004 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: Bootstrap starting.
I20240502 08:19:19.551972 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c0f287a1e0407c8b2a91c733c87f80" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.551923 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c0f287a1e0407c8b2a91c733c87f80" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.552275 29962 raft_consensus.cc:3037] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.554394 30004 tablet_bootstrap.cc:654] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.555625 29962 raft_consensus.cc:2454] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.562649 30009 raft_consensus.cc:686] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:19.562475 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.563681 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.564016 30009 consensus_queue.cc:237] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.565352 30008 tablet_bootstrap.cc:492] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.565495 30008 ts_tablet_manager.cc:1367] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.074s user 0.030s sys 0.042s
W20240502 08:19:19.565707 29853 leader_election.cc:341] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099): Illegal state: must be running to vote when last-logged opid is not known
W20240502 08:19:19.566052 29853 leader_election.cc:341] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:19.566074 30008 raft_consensus.cc:348] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.567545 30008 raft_consensus.cc:374] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.567507 29853 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:19.567652 30008 raft_consensus.cc:729] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.567801 30006 raft_consensus.cc:2726] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:19.567901 30004 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: No bootstrap required, opened a new log
I20240502 08:19:19.568070 30004 ts_tablet_manager.cc:1367] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.011s
I20240502 08:19:19.567955 30008 consensus_queue.cc:260] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.568524 30008 ts_tablet_manager.cc:1398] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:19.568845 30008 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.568799 29711 catalog_manager.cc:5484] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.570606 30008 tablet_bootstrap.cc:654] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.572065 30003 tablet_bootstrap.cc:492] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.572358 30003 ts_tablet_manager.cc:1367] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.000s
I20240502 08:19:19.573037 30008 tablet_bootstrap.cc:492] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.572935 30004 raft_consensus.cc:348] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.573220 30008 ts_tablet_manager.cc:1367] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:19.573252 30004 raft_consensus.cc:374] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.573387 30004 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.573676 30004 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.574136 30008 raft_consensus.cc:348] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.574323 30008 raft_consensus.cc:374] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.574462 30008 raft_consensus.cc:729] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.574684 30008 consensus_queue.cc:260] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.575047 30004 ts_tablet_manager.cc:1398] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:19.575232 30008 ts_tablet_manager.cc:1398] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:19.575492 30008 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.576773 30008 tablet_bootstrap.cc:654] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.573205 30003 raft_consensus.cc:348] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.577088 30003 raft_consensus.cc:374] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.577170 30003 raft_consensus.cc:729] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.577450 30003 consensus_queue.cc:260] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.578766 30003 ts_tablet_manager.cc:1398] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 08:19:19.579033 30003 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.580448 30003 tablet_bootstrap.cc:654] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.582330 30003 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.582329 30008 tablet_bootstrap.cc:492] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.582558 30003 ts_tablet_manager.cc:1367] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240502 08:19:19.582567 30008 ts_tablet_manager.cc:1367] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20240502 08:19:19.583413 30003 raft_consensus.cc:348] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.583407 30008 raft_consensus.cc:348] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.583706 30003 raft_consensus.cc:374] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.583734 30008 raft_consensus.cc:374] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.583832 30008 raft_consensus.cc:729] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.583837 30003 raft_consensus.cc:729] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.584115 30003 consensus_queue.cc:260] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.584124 30008 consensus_queue.cc:260] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.584719 30008 ts_tablet_manager.cc:1398] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:19.585050 30008 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.585698 30003 ts_tablet_manager.cc:1398] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:19.586053 30003 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Bootstrap starting.
I20240502 08:19:19.587474 30008 tablet_bootstrap.cc:654] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.589771 30003 tablet_bootstrap.cc:654] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.590021 30008 tablet_bootstrap.cc:492] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.590214 30008 ts_tablet_manager.cc:1367] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 08:19:19.591084 30008 raft_consensus.cc:348] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.591276 30008 raft_consensus.cc:374] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.591380 30008 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.591637 30008 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.591861 30003 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: No bootstrap required, opened a new log
I20240502 08:19:19.592041 30003 ts_tablet_manager.cc:1367] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20240502 08:19:19.592252 30008 ts_tablet_manager.cc:1398] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:19.592615 30008 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: Bootstrap starting.
I20240502 08:19:19.592898 30003 raft_consensus.cc:348] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.593152 30003 raft_consensus.cc:374] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.593241 30003 raft_consensus.cc:729] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.593554 30003 consensus_queue.cc:260] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.594136 30003 ts_tablet_manager.cc:1398] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:19.594565 30008 tablet_bootstrap.cc:654] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:19.597154 30008 tablet_bootstrap.cc:492] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: No bootstrap required, opened a new log
I20240502 08:19:19.597304 30008 ts_tablet_manager.cc:1367] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 08:19:19.597934 30008 raft_consensus.cc:348] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.598145 30008 raft_consensus.cc:374] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:19.598206 30008 raft_consensus.cc:729] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Initialized, Role: FOLLOWER
I20240502 08:19:19.598417 30008 consensus_queue.cc:260] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.598860 30008 ts_tablet_manager.cc:1398] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 08:19:19.621456 30013 raft_consensus.cc:482] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.621709 30013 raft_consensus.cc:504] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.622872 30013 leader_election.cc:288] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.628731 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.629081 29814 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.629520 29927 leader_election.cc:302] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.629909 30013 raft_consensus.cc:2781] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.630049 30013 raft_consensus.cc:482] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.630168 30013 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.630625 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.630883 29889 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.632661 30013 raft_consensus.cc:504] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.633317 30013 leader_election.cc:288] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.633826 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.633826 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.634099 29889 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.634126 29814 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.637174 29814 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.637174 29889 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.637651 29927 leader_election.cc:302] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.637967 30013 raft_consensus.cc:2781] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.638397 30013 raft_consensus.cc:686] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:19.638684 30013 consensus_queue.cc:237] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.640096 30009 raft_consensus.cc:482] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.640267 30009 raft_consensus.cc:504] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.640959 30009 leader_election.cc:288] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.641446 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.641688 29962 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 0.
I20240502 08:19:19.641808 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.641799 29711 catalog_manager.cc:5484] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:19.642096 29889 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 0.
I20240502 08:19:19.642128 29777 leader_election.cc:302] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.642416 30009 raft_consensus.cc:2781] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.642551 30009 raft_consensus.cc:482] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.642668 30009 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.645364 30009 raft_consensus.cc:504] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.645874 30009 leader_election.cc:288] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.646282 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.646469 29962 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.647610 30013 raft_consensus.cc:482] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.647789 30013 raft_consensus.cc:504] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.648356 30013 leader_election.cc:288] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.648654 29962 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.648767 29888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.648808 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.649078 29814 raft_consensus.cc:2454] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.649076 29888 raft_consensus.cc:2454] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.649202 29777 leader_election.cc:302] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.649199 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.649502 29927 leader_election.cc:302] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.649533 30009 raft_consensus.cc:2781] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.649607 29889 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.649741 30009 raft_consensus.cc:686] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:19.650192 30013 raft_consensus.cc:2781] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.650089 30009 consensus_queue.cc:237] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.650287 30013 raft_consensus.cc:482] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.650430 30013 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.652778 29889 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.653183 30013 raft_consensus.cc:504] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.653455 29711 catalog_manager.cc:5484] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.653859 30013 leader_election.cc:288] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.654196 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.654256 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.654395 29814 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.654489 29889 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.654541 30006 raft_consensus.cc:482] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.654675 30006 raft_consensus.cc:504] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.655313 30006 leader_election.cc:288] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.655956 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.656147 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.656252 29813 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.656523 29962 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.656751 30006 raft_consensus.cc:482] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.656800 29853 leader_election.cc:302] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.656939 30006 raft_consensus.cc:504] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.657419 29814 raft_consensus.cc:2454] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.657496 30006 leader_election.cc:288] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.657653 30006 raft_consensus.cc:2781] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.657743 30006 raft_consensus.cc:482] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.657807 29927 leader_election.cc:302] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.657902 30006 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.658546 29889 raft_consensus.cc:2454] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.659875 30013 raft_consensus.cc:2781] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.660352 30013 raft_consensus.cc:686] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:19.660674 30013 consensus_queue.cc:237] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.660715 30006 raft_consensus.cc:504] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.661566 30006 leader_election.cc:288] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.662046 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.662298 29814 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.662369 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.662560 29962 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.663498 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.663597 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.663595 29853 leader_election.cc:302] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.663858 29962 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.663890 29814 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.663858 29711 catalog_manager.cc:5484] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:19.664247 30006 raft_consensus.cc:2781] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.664391 30006 raft_consensus.cc:482] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.664508 30006 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.666594 29962 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.667062 29853 leader_election.cc:302] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.667373 29814 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.667385 30049 raft_consensus.cc:2781] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.668301 30006 raft_consensus.cc:504] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.668913 30006 leader_election.cc:288] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.669665 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.669665 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.669879 29962 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.669973 29814 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.671929 29962 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.672288 29853 leader_election.cc:302] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.672542 30006 raft_consensus.cc:2781] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.672665 30006 raft_consensus.cc:686] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:19.672992 30006 consensus_queue.cc:237] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.673338 30052 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.673506 30052 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.673816 29814 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.674504 30013 raft_consensus.cc:482] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.674871 30052 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.674984 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.674998 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.675222 29962 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.675338 29814 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 0.
I20240502 08:19:19.675433 30013 raft_consensus.cc:504] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.675707 29853 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.676126 30052 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.676326 30013 leader_election.cc:288] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.676503 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.676584 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.676811 29889 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.676852 29814 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.677304 29927 leader_election.cc:302] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.677650 30013 raft_consensus.cc:2781] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.677841 30052 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.677851 30013 raft_consensus.cc:482] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.678011 30052 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.678236 30013 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.682466 30052 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.682479 30013 raft_consensus.cc:504] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.683225 30049 raft_consensus.cc:686] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:19.683646 30013 leader_election.cc:288] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.683727 30049 consensus_queue.cc:237] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.684345 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.684481 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.684583 29813 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.684656 29889 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.684401 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.685241 29814 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.687930 29889 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.688268 29813 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.689194 30052 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.689258 29814 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.689297 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.689553 29927 leader_election.cc:302] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.689623 29962 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.689888 29853 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.690093 30013 raft_consensus.cc:2781] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.690441 30049 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.690603 30049 raft_consensus.cc:686] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:19.690316 29711 catalog_manager.cc:5484] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 0 to 1, leader changed from <none> to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 1 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.690887 30049 consensus_queue.cc:237] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.690315 30013 raft_consensus.cc:686] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:19.691851 30013 consensus_queue.cc:237] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.692684 29962 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 1.
I20240502 08:19:19.694880 29710 catalog_manager.cc:5484] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:19.695852 30009 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.696049 30009 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.696663 30009 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.697113 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.696990 29711 catalog_manager.cc:5484] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 0 to 1, leader changed from <none> to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 1 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.697319 29889 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 0.
I20240502 08:19:19.697698 29777 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.697645 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26" is_pre_election: true
I20240502 08:19:19.697525 29711 catalog_manager.cc:5484] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 0 to 1, leader changed from <none> to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 1 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.697881 29962 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 0.
I20240502 08:19:19.697996 30009 raft_consensus.cc:2781] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.698099 30009 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.698208 30009 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.700608 30009 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.701197 30009 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:19.701534 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.701663 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:19.701804 29889 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.701829 29962 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.704864 29962 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.704859 29889 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 1.
I20240502 08:19:19.705291 29777 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.705575 30009 raft_consensus.cc:2781] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.705765 30009 raft_consensus.cc:686] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:19.706063 30009 consensus_queue.cc:237] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.708761 29711 catalog_manager.cc:5484] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 1 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:19.717310 30013 raft_consensus.cc:482] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:19.717586 30013 raft_consensus.cc:504] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.718175 30013 leader_election.cc:288] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.718734 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" is_pre_election: true
I20240502 08:19:19.718775 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" is_pre_election: true
I20240502 08:19:19.718933 29814 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.718969 29889 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 0.
I20240502 08:19:19.719333 29927 leader_election.cc:302] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:19.719594 30013 raft_consensus.cc:2781] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:19.719677 30013 raft_consensus.cc:482] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:19.719785 30013 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.721679 30013 raft_consensus.cc:504] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.722241 30013 leader_election.cc:288] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:19.722687 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:19.722854 29814 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.722802 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:19.722999 29889 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:19.725001 29889 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.725023 29814 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 1.
I20240502 08:19:19.725390 29927 leader_election.cc:302] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:19.725630 30013 raft_consensus.cc:2781] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:19.725791 30013 raft_consensus.cc:686] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:19.726092 30013 consensus_queue.cc:237] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:19.728576 29711 catalog_manager.cc:5484] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:19.847164 29889 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:38196
I20240502 08:19:19.847455 29889 raft_consensus.cc:595] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:19.856009 29962 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:19.856256 29962 raft_consensus.cc:595] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:19.858330 29962 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:19.858541 29962 raft_consensus.cc:595] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:19.860177 29962 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:19.860330 29962 raft_consensus.cc:595] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:19.866151 29814 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:39062
I20240502 08:19:19.866335 29814 raft_consensus.cc:595] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Received request to transfer leadership to TS 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:19.869038 29962 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:19.869241 29962 raft_consensus.cc:595] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Received request to transfer leadership to TS 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:19.871321 29814 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "46e6424227c94031ae73aad1665b9711"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:39062
I20240502 08:19:19.871512 29814 raft_consensus.cc:595] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Received request to transfer leadership to TS 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:19.873384 29889 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
mode: GRACEFUL
new_leader_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:38196
I20240502 08:19:19.873569 29889 raft_consensus.cc:595] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Received request to transfer leadership to TS 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:19.984023 30009 consensus_queue.cc:1035] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:19.988517 30029 consensus_queue.cc:1035] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.023595 30013 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.027202 30046 raft_consensus.cc:979] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.027410 30013 raft_consensus.cc:1067] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.029443 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39050
I20240502 08:19:20.030831 29813 raft_consensus.cc:482] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.031195 29813 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.033413 30029 consensus_queue.cc:1035] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.037088 30013 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.037447 29813 raft_consensus.cc:504] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.038491 29813 leader_election.cc:288] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.039094 30029 consensus_queue.cc:1035] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.039220 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.039412 29962 raft_consensus.cc:3032] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.039515 29962 raft_consensus.cc:729] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:20.040154 30035 raft_consensus.cc:979] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.040297 30035 raft_consensus.cc:1067] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Signalling peer 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.039819 29962 consensus_queue.cc:260] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.040988 29962 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.042004 29888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:20.042392 29814 raft_consensus.cc:1226] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Rejecting Update request from peer 4190214649a04a5faf09ab13f99d2d26 for earlier term 1. Current term is 2. Ops: []
I20240502 08:19:20.043540 29886 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "46e6424227c94031ae73aad1665b9711"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:38174
I20240502 08:19:20.044400 29886 raft_consensus.cc:482] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.044661 29886 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.051060 29886 raft_consensus.cc:504] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.051421 29962 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.051857 29777 leader_election.cc:302] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters: 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:20.052306 30009 raft_consensus.cc:2781] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.052456 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.052772 29962 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.052798 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e6424227c94031ae73aad1665b9711" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:20.052987 29814 raft_consensus.cc:3032] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.053102 29814 raft_consensus.cc:729] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.053539 29886 leader_election.cc:288] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.053386 29814 consensus_queue.cc:260] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.054538 29814 raft_consensus.cc:3037] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.052479 30009 raft_consensus.cc:686] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.055502 30009 consensus_queue.cc:237] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.055972 29962 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 2.
I20240502 08:19:20.056223 29963 raft_consensus.cc:1226] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Rejecting Update request from peer 1d412f07c2c1489d9b64a9fd52593ba9 for earlier term 1. Current term is 2. Ops: []
I20240502 08:19:20.056682 29853 leader_election.cc:302] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:20.057143 30006 raft_consensus.cc:2781] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.057303 30006 raft_consensus.cc:686] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:20.057575 30006 consensus_queue.cc:237] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.058364 30052 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.059062 29814 raft_consensus.cc:2454] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 2.
I20240502 08:19:20.060276 29711 catalog_manager.cc:5484] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 1 to 2, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 2 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.063405 29710 catalog_manager.cc:5484] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 1 to 2, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.064154 30006 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.069566 30006 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.073824 30051 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.076685 30051 raft_consensus.cc:979] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.076865 30051 raft_consensus.cc:1067] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.077589 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39042
I20240502 08:19:20.077791 29813 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.077975 29813 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.080150 29813 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.080193 30013 consensus_queue.cc:1035] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.081121 29886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:20.081403 29886 raft_consensus.cc:3032] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.081493 29813 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.081542 29886 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:20.081429 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.081926 29962 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.081960 29886 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.082311 29886 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.085057 29886 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.086014 29962 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.086848 29777 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:20.087172 30009 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.087335 30009 raft_consensus.cc:686] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.087615 30046 raft_consensus.cc:979] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.087639 30009 consensus_queue.cc:237] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.088150 30046 raft_consensus.cc:1067] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.090196 29814 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39050
I20240502 08:19:20.090461 29814 raft_consensus.cc:482] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.090626 29814 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.093253 29814 raft_consensus.cc:504] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.094439 30046 consensus_queue.cc:1035] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.095084 30051 consensus_queue.cc:1035] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.095191 29814 leader_election.cc:288] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.095975 29710 catalog_manager.cc:5484] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 1 to 2, leader changed from 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.096318 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:20.097831 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39aa0008e8d4a5b809f8c6a03a061e2" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.098031 29962 raft_consensus.cc:3032] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.098116 29962 raft_consensus.cc:729] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:20.098457 29962 consensus_queue.cc:260] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.099133 29962 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.103986 29962 raft_consensus.cc:2454] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.104449 29777 leader_election.cc:302] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters: 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:20.104450 30049 consensus_queue.cc:1035] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.105011 30009 raft_consensus.cc:2781] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.105206 30009 raft_consensus.cc:686] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.105515 30009 consensus_queue.cc:237] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.108433 29709 catalog_manager.cc:5484] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 1 to 2, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.108772 30046 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.109470 30049 raft_consensus.cc:979] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: : Instructing follower 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:20.109661 30049 raft_consensus.cc:1067] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Signalling peer 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:20.110754 29963 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:59758
I20240502 08:19:20.110955 29963 raft_consensus.cc:482] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.111085 29963 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.115223 29963 raft_consensus.cc:504] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.116288 29963 leader_election.cc:288] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 2 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:20.116928 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:20.117142 29889 raft_consensus.cc:3032] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.117242 29889 raft_consensus.cc:729] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:20.117512 29889 consensus_queue.cc:260] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.117868 29889 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.118567 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05672c324e343a5b47ed0e202b146fe" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:20.118793 29814 raft_consensus.cc:3037] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.120999 29889 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 2.
I20240502 08:19:20.121618 29927 leader_election.cc:302] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:20.121922 30046 raft_consensus.cc:2781] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.122104 30046 raft_consensus.cc:686] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:20.122457 30046 consensus_queue.cc:237] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.122638 29814 raft_consensus.cc:2454] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 2.
I20240502 08:19:20.123070 30066 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.124099 30066 raft_consensus.cc:979] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.124245 30066 raft_consensus.cc:1067] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Signalling peer 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.124763 30009 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.125527 29889 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:38190
I20240502 08:19:20.125437 29709 catalog_manager.cc:5484] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 1 to 2, leader changed from 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130) to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 2 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:20.125777 29889 raft_consensus.cc:482] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.125973 29889 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.130249 29889 raft_consensus.cc:504] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.131690 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:20.132618 29886 raft_consensus.cc:1226] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Rejecting Update request from peer 4190214649a04a5faf09ab13f99d2d26 for earlier term 1. Current term is 2. Ops: []
I20240502 08:19:20.133255 30013 consensus_queue.cc:1046] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.133565 30013 raft_consensus.cc:3032] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.133736 30013 raft_consensus.cc:729] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:20.134114 30013 consensus_queue.cc:260] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.134531 30013 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.137187 29889 leader_election.cc:288] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.137928 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.138060 30029 raft_consensus.cc:979] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.138226 30035 raft_consensus.cc:1067] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Signalling peer 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:20.140292 30029 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.140475 29963 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 2.
I20240502 08:19:20.140866 29853 leader_election.cc:302] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters: 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:20.141712 29889 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:38174
I20240502 08:19:20.141927 29889 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.142052 29889 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.142215 30051 raft_consensus.cc:2781] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.142424 30051 raft_consensus.cc:686] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:20.142853 30051 consensus_queue.cc:237] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.144286 29889 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.144845 29889 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.145289 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.145360 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:20.145547 29814 raft_consensus.cc:3032] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.145681 29814 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.145979 29814 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.146260 29814 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.146880 29709 catalog_manager.cc:5484] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 1 to 2, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 2 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.148255 29814 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 2.
I20240502 08:19:20.148663 29853 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters: 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:20.148952 30051 raft_consensus.cc:2781] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.149116 30051 raft_consensus.cc:686] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:20.149405 30051 consensus_queue.cc:237] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.152242 29710 catalog_manager.cc:5484] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 1 to 2, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 2 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.273449 30013 consensus_queue.cc:1035] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.276235 30046 raft_consensus.cc:979] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.276396 30046 raft_consensus.cc:1067] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:20.277287 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39050
I20240502 08:19:20.277837 29813 raft_consensus.cc:482] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:20.277990 29813 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.278271 30046 consensus_queue.cc:1035] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.280740 29813 raft_consensus.cc:504] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.281792 29813 leader_election.cc:288] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:20.282225 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:20.282495 29962 raft_consensus.cc:3032] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:20.282595 29962 raft_consensus.cc:729] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:20.282658 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d58f4d9d5a4809a3b4a1b0a0c4baaa" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:20.282824 29889 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.282909 29962 consensus_queue.cc:260] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.283334 29962 raft_consensus.cc:3037] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.285367 29889 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.285789 29777 leader_election.cc:302] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:20.286175 30029 raft_consensus.cc:2781] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:20.286285 29962 raft_consensus.cc:2454] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 2.
I20240502 08:19:20.286327 30029 raft_consensus.cc:686] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:20.286713 30029 consensus_queue.cc:237] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:20.288834 29709 catalog_manager.cc:5484] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 1 to 2, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 2 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:20.485711 29813 raft_consensus.cc:1261] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.486320 30052 consensus_queue.cc:1035] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.489096 29962 raft_consensus.cc:1261] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.489609 30052 consensus_queue.cc:1035] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.546341 29889 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.546914 30029 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.549849 29962 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.550460 30035 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.555919 29813 raft_consensus.cc:1261] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.556355 30046 consensus_queue.cc:1035] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.559301 29889 raft_consensus.cc:1261] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.559965 30013 consensus_queue.cc:1035] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.572774 29962 raft_consensus.cc:1261] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.573273 30052 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.576056 29813 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.579392 29813 raft_consensus.cc:1261] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.579864 30052 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:20.582121 29962 raft_consensus.cc:1261] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.582634 30029 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.585497 29889 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.588035 29889 raft_consensus.cc:1261] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.588579 30029 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.606703 29813 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.607292 30052 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.610256 29962 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.613881 29962 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.614423 30006 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.641002 29887 raft_consensus.cc:3037] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:20.643182 29887 raft_consensus.cc:1261] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.643787 30029 consensus_queue.cc:1035] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.646837 29962 raft_consensus.cc:1261] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.647300 30029 consensus_queue.cc:1035] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.889050 29887 raft_consensus.cc:1261] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.889653 30029 consensus_queue.cc:1035] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:20.893563 29962 raft_consensus.cc:1261] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:20.894143 30084 consensus_queue.cc:1035] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:22.885959 29194 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240502 08:19:22.886225 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:22.900640 29887 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
mode: GRACEFUL
new_leader_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:38198
I20240502 08:19:22.900909 29887 raft_consensus.cc:595] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Received request to transfer leadership to TS 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:22.907104 29813 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:39072
I20240502 08:19:22.907347 29813 raft_consensus.cc:595] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Received request to transfer leadership to TS 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:22.907858 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 08:19:22.908078 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:23.114882 30090 raft_consensus.cc:979] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: : Instructing follower 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:23.115059 30090 raft_consensus.cc:1067] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Signalling peer 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:23.115620 29962 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:59758
I20240502 08:19:23.115831 29962 raft_consensus.cc:482] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:23.115942 29962 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:23.117975 29962 raft_consensus.cc:504] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.118660 29962 leader_election.cc:288] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 2 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:23.119115 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:23.119134 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:23.119334 29813 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:23.119339 29887 raft_consensus.cc:3032] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Stepping down as leader of term 1
I20240502 08:19:23.119450 29887 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:23.119737 29887 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.120074 29887 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Advancing to term 2
I20240502 08:19:23.121527 29813 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 2.
I20240502 08:19:23.121989 29927 leader_election.cc:302] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:23.122126 29887 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 2.
I20240502 08:19:23.122325 30086 raft_consensus.cc:2781] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 08:19:23.122821 30086 raft_consensus.cc:686] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:23.123162 30086 consensus_queue.cc:237] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.125622 29709 catalog_manager.cc:5484] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 1 to 2, leader changed from 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130) to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 2 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:23.129066 30035 raft_consensus.cc:979] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:23.129222 30035 raft_consensus.cc:1067] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Signalling peer 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:23.129925 29962 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:59754
I20240502 08:19:23.130131 29962 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:23.130255 29962 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:23.132211 29962 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.132752 29962 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 3 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527)
I20240502 08:19:23.133163 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:23.133214 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:23.133412 29887 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:23.133441 29813 raft_consensus.cc:3032] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:23.133512 29813 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:23.133796 29813 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.134145 29813 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:23.135740 29887 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 3.
I20240502 08:19:23.136174 29927 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:23.136304 29813 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 3.
I20240502 08:19:23.136550 30086 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:23.136745 30086 raft_consensus.cc:686] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:23.137012 30086 consensus_queue.cc:237] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:23.139839 29709 catalog_manager.cc:5484] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 2 to 3, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 3 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:23.525323 29887 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:23.525923 30086 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:23.530067 29813 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 08:19:23.530781 30086 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:23.551061 29813 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:23.551750 30086 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:23.555476 29887 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:23.556216 30086 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:23.908543 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:23.910225 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:23.910475 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:24.910859 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:24.912545 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:24.912740 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:25.913127 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:25.915321 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:25.915566 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:26.916065 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:26.917893 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:26.918095 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:27.918613 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:27.920372 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:27.920588 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:28.921011 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:28.922938 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:28.923171 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:29.923657 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:29.925495 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:29.925745 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:30.926183 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:30.927876 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:30.928063 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:31.928527 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:31.930186 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:31.930435 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:32.941195 29194 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240502 08:19:32.942965 29963 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:32.943151 29963 raft_consensus.cc:595] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:32.948843 29887 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:38196
I20240502 08:19:32.949059 29887 raft_consensus.cc:595] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:32.951002 29963 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:59774
I20240502 08:19:32.951177 29963 raft_consensus.cc:595] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:32.952991 29887 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
mode: GRACEFUL
new_leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:38196
I20240502 08:19:32.953173 29887 raft_consensus.cc:595] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Received request to transfer leadership to TS 1d412f07c2c1489d9b64a9fd52593ba9
I20240502 08:19:33.046943 30112 raft_consensus.cc:979] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.047142 30112 raft_consensus.cc:1067] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.047802 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39050
I20240502 08:19:33.047994 29813 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:33.048100 29813 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:33.050007 29813 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.050585 29813 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 4 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:33.051066 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:33.051178 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:33.051280 29887 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:33.051386 29963 raft_consensus.cc:3032] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:33.051524 29963 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:33.051812 29963 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.052158 29963 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:33.053483 29887 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 4.
I20240502 08:19:33.053884 29777 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:33.054174 30035 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:33.054272 29963 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 4.
I20240502 08:19:33.054636 30035 raft_consensus.cc:686] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:33.055054 30035 consensus_queue.cc:237] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.057614 29710 catalog_manager.cc:5484] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 3 to 4, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 4 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:33.116689 30110 raft_consensus.cc:979] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.116875 30110 raft_consensus.cc:1067] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.117518 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39050
I20240502 08:19:33.117684 29813 raft_consensus.cc:482] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:33.117835 29813 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.119797 29813 raft_consensus.cc:504] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.120352 29813 leader_election.cc:288] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:33.120800 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:33.120846 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:33.121042 29887 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.121066 29963 raft_consensus.cc:3032] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:33.121169 29963 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:33.121428 29963 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.121768 29963 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.123174 29887 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.123729 29777 leader_election.cc:302] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:33.123795 29963 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.124019 30035 raft_consensus.cc:2781] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:33.124171 30035 raft_consensus.cc:686] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:33.124403 30035 consensus_queue.cc:237] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.126936 29710 catalog_manager.cc:5484] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 2 to 3, leader changed from 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 3 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:33.200635 30090 raft_consensus.cc:979] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.200857 30120 raft_consensus.cc:1067] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.201592 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39042
I20240502 08:19:33.201807 29813 raft_consensus.cc:482] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:33.201915 29813 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.203796 29813 raft_consensus.cc:504] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.204352 29813 leader_election.cc:288] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:33.204821 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:33.204901 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777ff69ba93f4d17a207e0a91385976c" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:33.205049 29963 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.205053 29887 raft_consensus.cc:3032] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:33.205188 29887 raft_consensus.cc:729] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:33.205483 29887 consensus_queue.cc:260] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.205895 29887 raft_consensus.cc:3037] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.208273 29963 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.208684 29887 raft_consensus.cc:2454] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.208739 29777 leader_election.cc:302] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:33.209086 30035 raft_consensus.cc:2781] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:33.209247 30035 raft_consensus.cc:686] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:33.209496 30035 consensus_queue.cc:237] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.211971 29710 catalog_manager.cc:5484] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 2 to 3, leader changed from 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 3 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:33.277076 30090 raft_consensus.cc:979] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: : Instructing follower 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.277271 30090 raft_consensus.cc:1067] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Signalling peer 1d412f07c2c1489d9b64a9fd52593ba9 to start an election
I20240502 08:19:33.277916 29813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
from {username='slave'} at 127.0.0.1:39042
I20240502 08:19:33.278090 29813 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:33.278208 29813 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.280131 29813 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.280735 29813 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:33.281201 29963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:33.281229 29887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:33.281440 29887 raft_consensus.cc:3032] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:33.281450 29963 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.281570 29887 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:33.281893 29887 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.282326 29887 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:33.284627 29963 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.285082 29887 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d412f07c2c1489d9b64a9fd52593ba9 in term 3.
I20240502 08:19:33.285095 29777 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d412f07c2c1489d9b64a9fd52593ba9, 4190214649a04a5faf09ab13f99d2d26; no voters:
I20240502 08:19:33.285404 30035 raft_consensus.cc:2781] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:33.285552 30035 raft_consensus.cc:686] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Becoming Leader. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:33.285792 30035 consensus_queue.cc:237] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:33.288234 29710 catalog_manager.cc:5484] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 reported cstate change: term changed from 2 to 3, leader changed from 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130) to 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129). New cstate: current_term: 3 leader_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:33.466853 29887 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:33.467449 30035 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:33.471699 29963 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:33.472400 30113 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:33.580003 29887 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.580570 30113 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:33.584174 29963 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.584844 30113 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:33.617458 29887 raft_consensus.cc:1261] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.618114 30113 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:33.621930 29963 raft_consensus.cc:1261] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.622611 30131 consensus_queue.cc:1035] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:33.844549 29887 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.845135 30131 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:33.848553 29962 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Refusing update from remote peer 1d412f07c2c1489d9b64a9fd52593ba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:33.849215 30131 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:35.966634 29194 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240502 08:19:35.966902 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:35.969288 29813 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:39072
I20240502 08:19:35.969496 29813 raft_consensus.cc:595] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Received request to transfer leadership to TS 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:35.970451 29813 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:39072
I20240502 08:19:35.970619 29813 raft_consensus.cc:595] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Received request to transfer leadership to TS 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:35.971441 29813 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:39072
I20240502 08:19:35.971589 29813 raft_consensus.cc:595] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Received request to transfer leadership to TS 762cd15c1a5c4d3ba641c5fdcbb4906b
I20240502 08:19:35.972424 29813 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
mode: GRACEFUL
new_leader_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:39072
I20240502 08:19:35.972604 29813 raft_consensus.cc:595] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 LEADER]: Received request to transfer leadership to TS 4190214649a04a5faf09ab13f99d2d26
I20240502 08:19:35.972962 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240502 08:19:35.973191 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:36.233773 30138 raft_consensus.cc:979] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:36.233978 30138 raft_consensus.cc:1067] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Signalling peer 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:36.234706 29962 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:59754
I20240502 08:19:36.234921 29962 raft_consensus.cc:482] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:36.235069 29962 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.237666 29962 raft_consensus.cc:504] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.238495 29962 leader_election.cc:288] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 4 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523)
I20240502 08:19:36.239007 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:36.239073 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d28cad0c8cf489f839f14b65b59dc51" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:36.239236 29813 raft_consensus.cc:3032] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:36.239311 29889 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.239331 29813 raft_consensus.cc:729] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:36.239678 29813 consensus_queue.cc:260] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.239987 29813 raft_consensus.cc:3037] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.241677 29889 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 4.
I20240502 08:19:36.242058 29813 raft_consensus.cc:2454] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 4.
I20240502 08:19:36.242223 29927 leader_election.cc:302] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:36.242580 30110 raft_consensus.cc:2781] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:36.242910 30110 raft_consensus.cc:686] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 4 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:36.243170 30110 consensus_queue.cc:237] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.245770 29711 catalog_manager.cc:5484] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 3 to 4, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 4 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:36.273583 30139 raft_consensus.cc:979] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:36.273738 30139 raft_consensus.cc:1067] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Signalling peer 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:36.274454 29889 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:38174
I20240502 08:19:36.274626 29889 raft_consensus.cc:482] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:36.274732 29889 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.276654 29889 raft_consensus.cc:504] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.277465 29889 leader_election.cc:288] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 4 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:36.277880 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:36.277961 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12ebbb3d6c6c40a8b3f597f5ea802f85" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:36.278095 29813 raft_consensus.cc:3032] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 08:19:36.278201 29813 raft_consensus.cc:729] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:36.278208 29962 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.278529 29813 consensus_queue.cc:260] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.278844 29813 raft_consensus.cc:3037] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Advancing to term 4
I20240502 08:19:36.280408 29962 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 4.
I20240502 08:19:36.280871 29853 leader_election.cc:302] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:36.280951 29813 raft_consensus.cc:2454] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 4.
I20240502 08:19:36.281229 30090 raft_consensus.cc:2781] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Leader election won for term 4
I20240502 08:19:36.281657 30090 raft_consensus.cc:686] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:36.281982 30090 consensus_queue.cc:237] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.284281 30138 raft_consensus.cc:979] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:36.284446 30138 raft_consensus.cc:1067] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 LEADER]: Signalling peer 4190214649a04a5faf09ab13f99d2d26 to start an election
I20240502 08:19:36.285152 29962 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd"
dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
from {username='slave'} at 127.0.0.1:59754
I20240502 08:19:36.284947 29711 catalog_manager.cc:5484] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 3 to 4, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 4 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:36.285346 29962 raft_consensus.cc:482] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:36.285477 29962 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:36.288064 29962 raft_consensus.cc:504] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.288743 29962 leader_election.cc:288] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 5 election: Requested vote from peers 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130:34523), 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527)
I20240502 08:19:36.289153 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:36.289130 29889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d082e87c880045e28770926b5d56d1fd" candidate_uuid: "4190214649a04a5faf09ab13f99d2d26" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
I20240502 08:19:36.289451 29813 raft_consensus.cc:3032] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 LEADER]: Stepping down as leader of term 4
I20240502 08:19:36.289470 29889 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:36.289579 29813 raft_consensus.cc:729] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:36.289889 29813 consensus_queue.cc:260] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.290295 29813 raft_consensus.cc:3037] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Advancing to term 5
I20240502 08:19:36.292567 29889 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 5.
I20240502 08:19:36.293005 29813 raft_consensus.cc:2454] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4190214649a04a5faf09ab13f99d2d26 in term 5.
I20240502 08:19:36.293058 29927 leader_election.cc:302] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:36.293371 30110 raft_consensus.cc:2781] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 5 FOLLOWER]: Leader election won for term 5
I20240502 08:19:36.293529 30110 raft_consensus.cc:686] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 5 LEADER]: Becoming Leader. State: Replica: 4190214649a04a5faf09ab13f99d2d26, State: Running, Role: LEADER
I20240502 08:19:36.293785 30110 consensus_queue.cc:237] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.296427 29711 catalog_manager.cc:5484] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 reported cstate change: term changed from 4 to 5, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131). New cstate: current_term: 5 leader_uuid: "4190214649a04a5faf09ab13f99d2d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:36.416000 30139 raft_consensus.cc:979] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: : Instructing follower 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:36.416167 30139 raft_consensus.cc:1067] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Signalling peer 762cd15c1a5c4d3ba641c5fdcbb4906b to start an election
I20240502 08:19:36.416894 29889 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838"
dest_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b"
from {username='slave'} at 127.0.0.1:38174
I20240502 08:19:36.417104 29889 raft_consensus.cc:482] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 08:19:36.417228 29889 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:36.419337 29889 raft_consensus.cc:504] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.420009 29889 leader_election.cc:288] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 3 election: Requested vote from peers 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129:46527), 4190214649a04a5faf09ab13f99d2d26 (127.28.130.131:43099)
I20240502 08:19:36.420508 29813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d412f07c2c1489d9b64a9fd52593ba9"
I20240502 08:19:36.420573 29962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3765d2d56044db805b3200fd38d838" candidate_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4190214649a04a5faf09ab13f99d2d26"
I20240502 08:19:36.420712 29813 raft_consensus.cc:3032] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 08:19:36.420807 29962 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:36.420812 29813 raft_consensus.cc:729] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d412f07c2c1489d9b64a9fd52593ba9, State: Running, Role: LEADER
I20240502 08:19:36.421154 29813 consensus_queue.cc:260] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.421469 29813 raft_consensus.cc:3037] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 08:19:36.423087 29962 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 3.
I20240502 08:19:36.423512 29853 leader_election.cc:302] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4190214649a04a5faf09ab13f99d2d26, 762cd15c1a5c4d3ba641c5fdcbb4906b; no voters:
I20240502 08:19:36.423523 29813 raft_consensus.cc:2454] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762cd15c1a5c4d3ba641c5fdcbb4906b in term 3.
I20240502 08:19:36.423790 30090 raft_consensus.cc:2781] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Leader election won for term 3
I20240502 08:19:36.423946 30090 raft_consensus.cc:686] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 LEADER]: Becoming Leader. State: Replica: 762cd15c1a5c4d3ba641c5fdcbb4906b, State: Running, Role: LEADER
I20240502 08:19:36.424203 30090 consensus_queue.cc:237] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } }
I20240502 08:19:36.426832 29711 catalog_manager.cc:5484] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b reported cstate change: term changed from 2 to 3, leader changed from 1d412f07c2c1489d9b64a9fd52593ba9 (127.28.130.129) to 762cd15c1a5c4d3ba641c5fdcbb4906b (127.28.130.130). New cstate: current_term: 3 leader_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:36.710197 29813 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 5 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 08:19:36.710837 30110 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 08:19:36.715220 29889 raft_consensus.cc:1261] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 5 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 08:19:36.715809 30110 consensus_queue.cc:1035] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 08:19:36.742244 29813 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:36.742889 30110 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:36.746744 29889 raft_consensus.cc:1261] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Refusing update from remote peer 4190214649a04a5faf09ab13f99d2d26: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:36.747352 30140 consensus_queue.cc:1035] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762cd15c1a5c4d3ba641c5fdcbb4906b" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 34523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:36.899236 29813 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:36.899806 30146 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:36.903441 29962 raft_consensus.cc:1261] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 08:19:36.904034 30146 consensus_queue.cc:1035] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:36.938522 29813 raft_consensus.cc:1261] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:36.939117 30146 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d412f07c2c1489d9b64a9fd52593ba9" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:36.942762 29962 raft_consensus.cc:1261] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Refusing update from remote peer 762cd15c1a5c4d3ba641c5fdcbb4906b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 08:19:36.943531 30090 consensus_queue.cc:1035] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4190214649a04a5faf09ab13f99d2d26" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 43099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:36.973721 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:36.976490 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:36.976737 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:37.977169 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:37.979064 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:37.979230 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:38.979727 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:38.981410 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:38.981590 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:39.982055 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:39.983778 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:39.983959 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:40.984524 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:40.986156 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:40.986373 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:41.986718 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:41.988430 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:41.988639 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:42.989157 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:42.991161 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:42.991366 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:43.991875 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:43.993659 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:43.993829 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:44.994315 29194 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 08:19:44.996040 29194 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 08:19:44.996235 29194 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 08:19:46.007577 29194 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240502 08:19:46.007789 29194 tablet_server.cc:178] TabletServer@127.28.130.129:0 shutting down...
I20240502 08:19:46.027066 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:46.027416 29194 tablet_replica.cc:330] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.027639 29194 raft_consensus.cc:2229] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.027892 29194 raft_consensus.cc:2258] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.028743 29194 tablet_replica.cc:330] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.028965 29194 raft_consensus.cc:2229] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.029152 29194 raft_consensus.cc:2258] T c05672c324e343a5b47ed0e202b146fe P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.029770 29194 tablet_replica.cc:330] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.029950 29194 raft_consensus.cc:2229] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.030107 29194 raft_consensus.cc:2258] T 46e6424227c94031ae73aad1665b9711 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.030727 29194 tablet_replica.cc:330] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.030910 29194 raft_consensus.cc:2229] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.031059 29194 raft_consensus.cc:2258] T d082e87c880045e28770926b5d56d1fd P 1d412f07c2c1489d9b64a9fd52593ba9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.031626 29194 tablet_replica.cc:330] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.031771 29194 raft_consensus.cc:2229] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.031929 29194 raft_consensus.cc:2258] T 6e3765d2d56044db805b3200fd38d838 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.032399 29194 tablet_replica.cc:330] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.032536 29194 raft_consensus.cc:2229] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.032853 29194 raft_consensus.cc:2258] T 777ff69ba93f4d17a207e0a91385976c P 1d412f07c2c1489d9b64a9fd52593ba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.033282 29194 tablet_replica.cc:330] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.033388 29194 raft_consensus.cc:2229] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.033645 29194 raft_consensus.cc:2258] T c39aa0008e8d4a5b809f8c6a03a061e2 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.034121 29194 tablet_replica.cc:330] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.034261 29194 raft_consensus.cc:2229] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.034621 29194 raft_consensus.cc:2258] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 1d412f07c2c1489d9b64a9fd52593ba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.035138 29194 tablet_replica.cc:330] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.035283 29194 raft_consensus.cc:2229] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.035552 29194 raft_consensus.cc:2258] T 66c0f287a1e0407c8b2a91c733c87f80 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.036068 29194 tablet_replica.cc:330] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9: stopping tablet replica
I20240502 08:19:46.036203 29194 raft_consensus.cc:2229] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.036357 29194 raft_consensus.cc:2258] T 6d28cad0c8cf489f839f14b65b59dc51 P 1d412f07c2c1489d9b64a9fd52593ba9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.053124 29194 tablet_server.cc:194] TabletServer@127.28.130.129:0 shutdown complete.
I20240502 08:19:46.057320 29194 tablet_server.cc:178] TabletServer@127.28.130.130:0 shutting down...
I20240502 08:19:46.065389 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:46.065661 29194 tablet_replica.cc:330] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.065871 29194 raft_consensus.cc:2229] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.066187 29194 raft_consensus.cc:2258] T 46e6424227c94031ae73aad1665b9711 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.066804 29194 tablet_replica.cc:330] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.066949 29194 raft_consensus.cc:2229] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.067095 29194 raft_consensus.cc:2258] T c05672c324e343a5b47ed0e202b146fe P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.067503 29194 tablet_replica.cc:330] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.067625 29194 raft_consensus.cc:2229] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.067746 29194 raft_consensus.cc:2258] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.068112 29194 tablet_replica.cc:330] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.068236 29194 raft_consensus.cc:2229] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.068354 29194 raft_consensus.cc:2258] T 66c0f287a1e0407c8b2a91c733c87f80 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.068725 29194 tablet_replica.cc:330] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.068861 29194 raft_consensus.cc:2229] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.068969 29194 raft_consensus.cc:2258] T c39aa0008e8d4a5b809f8c6a03a061e2 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.069334 29194 tablet_replica.cc:330] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.069478 29194 raft_consensus.cc:2229] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.069587 29194 raft_consensus.cc:2258] T 777ff69ba93f4d17a207e0a91385976c P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.069932 29194 tablet_replica.cc:330] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.070050 29194 raft_consensus.cc:2229] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.070176 29194 raft_consensus.cc:2258] T d082e87c880045e28770926b5d56d1fd P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.070554 29194 tablet_replica.cc:330] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.070665 29194 raft_consensus.cc:2229] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.070894 29194 raft_consensus.cc:2258] T 6e3765d2d56044db805b3200fd38d838 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.071240 29194 tablet_replica.cc:330] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.071358 29194 raft_consensus.cc:2229] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.071544 29194 raft_consensus.cc:2258] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.071887 29194 tablet_replica.cc:330] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b: stopping tablet replica
I20240502 08:19:46.071964 29194 raft_consensus.cc:2229] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.072093 29194 raft_consensus.cc:2258] T 6d28cad0c8cf489f839f14b65b59dc51 P 762cd15c1a5c4d3ba641c5fdcbb4906b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.087002 29194 tablet_server.cc:194] TabletServer@127.28.130.130:0 shutdown complete.
I20240502 08:19:46.091446 29194 tablet_server.cc:178] TabletServer@127.28.130.131:0 shutting down...
I20240502 08:19:46.100069 29194 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 08:19:46.100351 29194 tablet_replica.cc:330] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.100533 29194 raft_consensus.cc:2229] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.100725 29194 raft_consensus.cc:2258] T 46e6424227c94031ae73aad1665b9711 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.101337 29194 tablet_replica.cc:330] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.101485 29194 raft_consensus.cc:2229] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.101634 29194 raft_consensus.cc:2258] T 12ebbb3d6c6c40a8b3f597f5ea802f85 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.102064 29194 tablet_replica.cc:330] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.102185 29194 raft_consensus.cc:2229] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 2 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.102461 29194 raft_consensus.cc:2258] T c05672c324e343a5b47ed0e202b146fe P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.102836 29194 tablet_replica.cc:330] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.102932 29194 raft_consensus.cc:2229] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.108155 29194 raft_consensus.cc:2258] T 6e3765d2d56044db805b3200fd38d838 P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.108750 29194 tablet_replica.cc:330] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.108881 29194 raft_consensus.cc:2229] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 5 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.109129 29194 raft_consensus.cc:2258] T d082e87c880045e28770926b5d56d1fd P 4190214649a04a5faf09ab13f99d2d26 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.109494 29194 tablet_replica.cc:330] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.109592 29194 raft_consensus.cc:2229] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.109694 29194 raft_consensus.cc:2258] T 777ff69ba93f4d17a207e0a91385976c P 4190214649a04a5faf09ab13f99d2d26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.110018 29194 tablet_replica.cc:330] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.110107 29194 raft_consensus.cc:2229] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.110200 29194 raft_consensus.cc:2258] T c39aa0008e8d4a5b809f8c6a03a061e2 P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.110605 29194 tablet_replica.cc:330] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.110697 29194 raft_consensus.cc:2229] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 4 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.110895 29194 raft_consensus.cc:2258] T 6d28cad0c8cf489f839f14b65b59dc51 P 4190214649a04a5faf09ab13f99d2d26 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.111218 29194 tablet_replica.cc:330] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.111307 29194 raft_consensus.cc:2229] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.111407 29194 raft_consensus.cc:2258] T c6d58f4d9d5a4809a3b4a1b0a0c4baaa P 4190214649a04a5faf09ab13f99d2d26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.111714 29194 tablet_replica.cc:330] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26: stopping tablet replica
I20240502 08:19:46.111806 29194 raft_consensus.cc:2229] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:46.111896 29194 raft_consensus.cc:2258] T 66c0f287a1e0407c8b2a91c733c87f80 P 4190214649a04a5faf09ab13f99d2d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.127029 29194 tablet_server.cc:194] TabletServer@127.28.130.131:0 shutdown complete.
I20240502 08:19:46.131469 29194 master.cc:537] Master@127.28.130.190:42931 shutting down...
I20240502 08:19:46.139021 29194 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 1 LEADER]: Raft consensus shutting down.
I20240502 08:19:46.139274 29194 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:46.139379 29194 tablet_replica.cc:330] T 00000000000000000000000000000000 P 16b251ef8ca641f182b59763e6884dac: stopping tablet replica
I20240502 08:19:46.152609 29194 master.cc:552] Master@127.28.130.190:42931 shutdown complete.
1d412f07c2c1489d9b64a9fd52593ba9 5
4190214649a04a5faf09ab13f99d2d26 1
762cd15c1a5c4d3ba641c5fdcbb4906b 4
1d412f07c2c1489d9b64a9fd52593ba9 4
4190214649a04a5faf09ab13f99d2d26 3
762cd15c1a5c4d3ba641c5fdcbb4906b 3
1d412f07c2c1489d9b64a9fd52593ba9 8
4190214649a04a5faf09ab13f99d2d26 1
762cd15c1a5c4d3ba641c5fdcbb4906b 1
1d412f07c2c1489d9b64a9fd52593ba9 4
4190214649a04a5faf09ab13f99d2d26 3
762cd15c1a5c4d3ba641c5fdcbb4906b 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27265 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240502 08:19:46.168047 29194 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.130.190:36393
I20240502 08:19:46.168527 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:46.171561 30167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.171993 30168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.172652 30170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:46.173188 29194 server_base.cc:1034] running on GCE node
I20240502 08:19:46.173434 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:46.173485 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:46.173516 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637986173512 us; error 0 us; skew 500 ppm
I20240502 08:19:46.173669 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:46.180739 29194 webserver.cc:460] Webserver started at http://127.28.130.190:39781/ using document root <none> and password file <none>
I20240502 08:19:46.181030 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:46.181105 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:46.181243 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:46.181922 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/master-0-root/instance:
uuid: "8d730e909d294bfca9aac84ce18d82cd"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.184520 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:46.186122 30175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.186492 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:46.186601 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/master-0-root
uuid: "8d730e909d294bfca9aac84ce18d82cd"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.186745 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:46.195214 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:46.195784 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:46.209224 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.190:36393
I20240502 08:19:46.209246 30226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.190:36393 every 8 connection(s)
I20240502 08:19:46.210649 30227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.214861 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd: Bootstrap starting.
I20240502 08:19:46.216171 30227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.217868 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd: No bootstrap required, opened a new log
I20240502 08:19:46.218555 30227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER }
I20240502 08:19:46.218704 30227 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:46.218781 30227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d730e909d294bfca9aac84ce18d82cd, State: Initialized, Role: FOLLOWER
I20240502 08:19:46.219117 30227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER }
I20240502 08:19:46.219235 30227 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:19:46.219293 30227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:19:46.219347 30227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:46.221135 30227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER }
I20240502 08:19:46.221416 30227 leader_election.cc:302] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d730e909d294bfca9aac84ce18d82cd; no voters:
I20240502 08:19:46.221837 30227 leader_election.cc:288] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 08:19:46.222013 30230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:46.222508 30230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [term 1 LEADER]: Becoming Leader. State: Replica: 8d730e909d294bfca9aac84ce18d82cd, State: Running, Role: LEADER
I20240502 08:19:46.222765 30230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER }
I20240502 08:19:46.222882 30227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [sys.catalog]: configured and running, proceeding with master startup.
I20240502 08:19:46.223680 30231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d730e909d294bfca9aac84ce18d82cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER } }
I20240502 08:19:46.223744 30232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d730e909d294bfca9aac84ce18d82cd. Latest consensus state: current_term: 1 leader_uuid: "8d730e909d294bfca9aac84ce18d82cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d730e909d294bfca9aac84ce18d82cd" member_type: VOTER } }
I20240502 08:19:46.223891 30231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [sys.catalog]: This master's current role is: LEADER
I20240502 08:19:46.223930 30232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd [sys.catalog]: This master's current role is: LEADER
I20240502 08:19:46.225023 30235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 08:19:46.226570 30235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 08:19:46.227978 29194 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 08:19:46.229350 30235 catalog_manager.cc:1347] Generated new cluster ID: 4b73e05025b7473786721dacbf740634
I20240502 08:19:46.229427 30235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 08:19:46.246778 30235 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 08:19:46.247571 30235 catalog_manager.cc:1504] Loading token signing keys...
I20240502 08:19:46.262532 30235 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8d730e909d294bfca9aac84ce18d82cd: Generated new TSK 0
I20240502 08:19:46.262804 30235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 08:19:46.293393 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:46.296712 30248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.297223 30249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.297839 30251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:46.298506 29194 server_base.cc:1034] running on GCE node
I20240502 08:19:46.298792 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:46.298851 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:46.298887 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637986298882 us; error 0 us; skew 500 ppm
I20240502 08:19:46.299031 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:46.300364 29194 webserver.cc:460] Webserver started at http://127.28.130.129:34885/ using document root <none> and password file <none>
I20240502 08:19:46.300588 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:46.300653 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:46.300786 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:46.301486 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/instance:
uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.304118 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 08:19:46.305619 30256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.305989 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240502 08:19:46.306094 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root
uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.306229 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:46.325019 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:46.325701 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:46.326439 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:46.327411 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:46.327476 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.327566 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:46.327607 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.340615 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.129:35355
I20240502 08:19:46.340626 30318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.129:35355 every 8 connection(s)
I20240502 08:19:46.342494 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:46.346135 30323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.346710 30324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:46.347498 29194 server_base.cc:1034] running on GCE node
W20240502 08:19:46.348075 30326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:46.348484 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:46.348553 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:46.348590 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637986348586 us; error 0 us; skew 500 ppm
I20240502 08:19:46.348747 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:46.349290 30319 heartbeater.cc:347] Connected to a master server at 127.28.130.190:36393
I20240502 08:19:46.349442 30319 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:46.349887 30319 heartbeater.cc:511] Master 127.28.130.190:36393 requested a full tablet report, sending...
I20240502 08:19:46.350193 29194 webserver.cc:460] Webserver started at http://127.28.130.130:41775/ using document root <none> and password file <none>
I20240502 08:19:46.350459 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:46.350536 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:46.350659 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:46.350862 30192 ts_manager.cc:194] Registered new tserver with Master: 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:46.351282 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/instance:
uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.351893 30192 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58686
I20240502 08:19:46.353979 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:46.355509 30331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.355845 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240502 08:19:46.355949 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root
uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.356051 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:46.362550 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:46.362980 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:46.363472 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:46.364205 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:46.364269 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.364336 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:46.364373 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.376574 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.130:38055
I20240502 08:19:46.376593 30393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.130:38055 every 8 connection(s)
I20240502 08:19:46.378129 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:46.381505 30397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.382177 30398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:46.382659 30400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:46.383365 29194 server_base.cc:1034] running on GCE node
I20240502 08:19:46.383632 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:46.383690 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:46.383713 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637986383710 us; error 0 us; skew 500 ppm
I20240502 08:19:46.383834 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:46.385406 29194 webserver.cc:460] Webserver started at http://127.28.130.131:35427/ using document root <none> and password file <none>
I20240502 08:19:46.385632 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:46.385700 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:46.385713 30394 heartbeater.cc:347] Connected to a master server at 127.28.130.190:36393
I20240502 08:19:46.385820 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:46.385844 30394 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:46.386257 30394 heartbeater.cc:511] Master 127.28.130.190:36393 requested a full tablet report, sending...
I20240502 08:19:46.386658 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/instance:
uuid: "f40077f920074fffba17e847ebc10339"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.387259 30192 ts_manager.cc:194] Registered new tserver with Master: 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:46.388307 30192 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58694
I20240502 08:19:46.389812 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:46.391407 30405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.391805 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:46.391899 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root
uuid: "f40077f920074fffba17e847ebc10339"
format_stamp: "Formatted at 2024-05-02 08:19:46 on dist-test-slave-330p"
I20240502 08:19:46.392024 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:46.406765 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:46.407331 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:46.407881 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:46.408629 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:46.408681 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.408753 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:46.408787 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:46.422092 30467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.131:34581 every 8 connection(s)
I20240502 08:19:46.422070 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.131:34581
I20240502 08:19:46.428719 30468 heartbeater.cc:347] Connected to a master server at 127.28.130.190:36393
I20240502 08:19:46.428844 30468 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:46.429183 30468 heartbeater.cc:511] Master 127.28.130.190:36393 requested a full tablet report, sending...
I20240502 08:19:46.429968 30192 ts_manager.cc:194] Registered new tserver with Master: f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:46.430670 30192 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58706
I20240502 08:19:46.430917 29194 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00782229s
I20240502 08:19:46.431807 29194 test_util.cc:268] Using random seed: 1142522684
I20240502 08:19:46.442559 30192 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58718:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 08:19:46.443816 30192 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 08:19:46.512059 30359 tablet_service.cc:1467] Processing CreateTablet for tablet ead734a2397f48ac8b7b82dbb0b3af91 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 08:19:46.512670 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ead734a2397f48ac8b7b82dbb0b3af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.514082 30358 tablet_service.cc:1467] Processing CreateTablet for tablet c69fc8a31e074b6fb20a9070605c173e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 08:19:46.514590 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69fc8a31e074b6fb20a9070605c173e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.514632 30433 tablet_service.cc:1467] Processing CreateTablet for tablet ead734a2397f48ac8b7b82dbb0b3af91 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 08:19:46.514743 30357 tablet_service.cc:1467] Processing CreateTablet for tablet a130bd930dd34683b20eebf600797fee (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 08:19:46.515077 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ead734a2397f48ac8b7b82dbb0b3af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.515108 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a130bd930dd34683b20eebf600797fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.518788 30432 tablet_service.cc:1467] Processing CreateTablet for tablet c69fc8a31e074b6fb20a9070605c173e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 08:19:46.519097 30425 tablet_service.cc:1467] Processing CreateTablet for tablet d1c63644a39642eeae800e736bdfebe3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 08:19:46.519402 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69fc8a31e074b6fb20a9070605c173e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.519469 30284 tablet_service.cc:1467] Processing CreateTablet for tablet ead734a2397f48ac8b7b82dbb0b3af91 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 08:19:46.519687 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1c63644a39642eeae800e736bdfebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.519667 30352 tablet_service.cc:1467] Processing CreateTablet for tablet ff8e4936b3de44e4a7be94c80ae260e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 08:19:46.518788 30424 tablet_service.cc:1467] Processing CreateTablet for tablet e9fcfc7235394ad2bc4c421686b5ada5 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 08:19:46.519908 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ead734a2397f48ac8b7b82dbb0b3af91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.520027 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff8e4936b3de44e4a7be94c80ae260e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.520145 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fcfc7235394ad2bc4c421686b5ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.522729 30351 tablet_service.cc:1467] Processing CreateTablet for tablet d1c63644a39642eeae800e736bdfebe3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 08:19:46.518770 30356 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac192fb53234cb0938ea6ff4eea665a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 08:19:46.523056 30427 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3667036991403bab82f9f76c36b65b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 08:19:46.523484 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3667036991403bab82f9f76c36b65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.523463 30283 tablet_service.cc:1467] Processing CreateTablet for tablet c69fc8a31e074b6fb20a9070605c173e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 08:19:46.523640 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac192fb53234cb0938ea6ff4eea665a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.523840 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69fc8a31e074b6fb20a9070605c173e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.519086 30354 tablet_service.cc:1467] Processing CreateTablet for tablet bb6c16bf46b1422393e430d5d836323a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 08:19:46.526697 30350 tablet_service.cc:1467] Processing CreateTablet for tablet e9fcfc7235394ad2bc4c421686b5ada5 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 08:19:46.526748 30428 tablet_service.cc:1467] Processing CreateTablet for tablet bb6c16bf46b1422393e430d5d836323a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 08:19:46.527582 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6c16bf46b1422393e430d5d836323a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.519086 30353 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3667036991403bab82f9f76c36b65b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 08:19:46.522745 30426 tablet_service.cc:1467] Processing CreateTablet for tablet ff8e4936b3de44e4a7be94c80ae260e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 08:19:46.529944 30351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1c63644a39642eeae800e736bdfebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.530831 30354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6c16bf46b1422393e430d5d836323a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.518770 30355 tablet_service.cc:1467] Processing CreateTablet for tablet c348f2f255a349079a86b142579e6f10 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 08:19:46.531797 30276 tablet_service.cc:1467] Processing CreateTablet for tablet d1c63644a39642eeae800e736bdfebe3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 08:19:46.532465 30277 tablet_service.cc:1467] Processing CreateTablet for tablet ff8e4936b3de44e4a7be94c80ae260e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 08:19:46.532853 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3667036991403bab82f9f76c36b65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.533762 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fcfc7235394ad2bc4c421686b5ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.536295 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff8e4936b3de44e4a7be94c80ae260e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.539605 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 5514ab40240743f8afcb372fcfa05f21 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 08:19:46.540077 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5514ab40240743f8afcb372fcfa05f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.540709 30427 tablet_service.cc:1467] Processing CreateTablet for tablet 98bc60419b9e4b508a2a4dc549d6c27e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 08:19:46.541118 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bc60419b9e4b508a2a4dc549d6c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.544965 30280 tablet_service.cc:1467] Processing CreateTablet for tablet c348f2f255a349079a86b142579e6f10 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 08:19:46.545506 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c348f2f255a349079a86b142579e6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.547312 30433 tablet_service.cc:1467] Processing CreateTablet for tablet 59692a88df104ec2ad428f6b097422ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 08:19:46.547648 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59692a88df104ec2ad428f6b097422ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.553839 30428 tablet_service.cc:1467] Processing CreateTablet for tablet e373972ec8f24e08b2b6a68c8c4db8b8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 08:19:46.554234 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e373972ec8f24e08b2b6a68c8c4db8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.555095 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c348f2f255a349079a86b142579e6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.559211 30358 tablet_service.cc:1467] Processing CreateTablet for tablet 5514ab40240743f8afcb372fcfa05f21 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 08:19:46.559705 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5514ab40240743f8afcb372fcfa05f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.561894 30483 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:46.562007 30424 tablet_service.cc:1467] Processing CreateTablet for tablet 82ae42e94e344ecfaaed26222ccc9b86 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 08:19:46.562268 30275 tablet_service.cc:1467] Processing CreateTablet for tablet e9fcfc7235394ad2bc4c421686b5ada5 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 08:19:46.563776 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ae42e94e344ecfaaed26222ccc9b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.564169 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff8e4936b3de44e4a7be94c80ae260e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.565551 30432 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd62f0603a487bb8b63859cce5f2c4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 08:19:46.565901 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd62f0603a487bb8b63859cce5f2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.566140 30357 tablet_service.cc:1467] Processing CreateTablet for tablet 98bc60419b9e4b508a2a4dc549d6c27e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 08:19:46.566622 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bc60419b9e4b508a2a4dc549d6c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.567241 30283 tablet_service.cc:1467] Processing CreateTablet for tablet 5514ab40240743f8afcb372fcfa05f21 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 08:19:46.568954 30431 tablet_service.cc:1467] Processing CreateTablet for tablet a130bd930dd34683b20eebf600797fee (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 08:19:46.569398 30431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a130bd930dd34683b20eebf600797fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.570423 30276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1c63644a39642eeae800e736bdfebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.571266 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5514ab40240743f8afcb372fcfa05f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.571659 30278 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3667036991403bab82f9f76c36b65b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 08:19:46.572966 30280 tablet_service.cc:1467] Processing CreateTablet for tablet 98bc60419b9e4b508a2a4dc549d6c27e (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 08:19:46.573256 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98bc60419b9e4b508a2a4dc549d6c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.574076 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c3667036991403bab82f9f76c36b65b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.574250 30282 tablet_service.cc:1467] Processing CreateTablet for tablet a130bd930dd34683b20eebf600797fee (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 08:19:46.574090 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac192fb53234cb0938ea6ff4eea665a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 08:19:46.575932 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac192fb53234cb0938ea6ff4eea665a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.576071 30281 tablet_service.cc:1467] Processing CreateTablet for tablet 1ac192fb53234cb0938ea6ff4eea665a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 08:19:46.579994 30429 tablet_service.cc:1467] Processing CreateTablet for tablet c348f2f255a349079a86b142579e6f10 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 08:19:46.580121 30279 tablet_service.cc:1467] Processing CreateTablet for tablet bb6c16bf46b1422393e430d5d836323a (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 08:19:46.580332 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fcfc7235394ad2bc4c421686b5ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.582118 30282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a130bd930dd34683b20eebf600797fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.584659 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ac192fb53234cb0938ea6ff4eea665a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.591341 30483 tablet_bootstrap.cc:654] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.600086 30352 tablet_service.cc:1467] Processing CreateTablet for tablet 59692a88df104ec2ad428f6b097422ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 08:19:46.600757 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59692a88df104ec2ad428f6b097422ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.601507 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6c16bf46b1422393e430d5d836323a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.601745 30484 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:46.602134 30429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c348f2f255a349079a86b142579e6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.641276 30426 tablet_service.cc:1467] Processing CreateTablet for tablet a5b04d480698434e9842efbe6fdf0038 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 08:19:46.645064 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b04d480698434e9842efbe6fdf0038. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.645231 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 59692a88df104ec2ad428f6b097422ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 08:19:46.650370 30284 tablet_service.cc:1467] Processing CreateTablet for tablet e373972ec8f24e08b2b6a68c8c4db8b8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 08:19:46.651044 30484 tablet_bootstrap.cc:654] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.651815 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59692a88df104ec2ad428f6b097422ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.652168 30425 tablet_service.cc:1467] Processing CreateTablet for tablet dbcb66f8a5d74601b1e0f156d06e30f4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 08:19:46.653003 30485 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:46.653898 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e373972ec8f24e08b2b6a68c8c4db8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.654755 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb66f8a5d74601b1e0f156d06e30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.656770 30424 tablet_service.cc:1467] Processing CreateTablet for tablet af3cd710facb49a19984c4a447033a41 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 08:19:46.659173 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af3cd710facb49a19984c4a447033a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.661757 30359 tablet_service.cc:1467] Processing CreateTablet for tablet e373972ec8f24e08b2b6a68c8c4db8b8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 08:19:46.662536 30483 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:46.665524 30483 ts_tablet_manager.cc:1367] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.101s user 0.011s sys 0.039s
I20240502 08:19:46.666005 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e373972ec8f24e08b2b6a68c8c4db8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.668212 30355 tablet_service.cc:1467] Processing CreateTablet for tablet 82ae42e94e344ecfaaed26222ccc9b86 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 08:19:46.674542 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ae42e94e344ecfaaed26222ccc9b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.680531 30277 tablet_service.cc:1467] Processing CreateTablet for tablet 82ae42e94e344ecfaaed26222ccc9b86 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 08:19:46.686985 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ae42e94e344ecfaaed26222ccc9b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.689057 30427 tablet_service.cc:1467] Processing CreateTablet for tablet 03bb20d8df564ad582b1211921a3eeb9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 08:19:46.690269 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bb20d8df564ad582b1211921a3eeb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.696655 30483 raft_consensus.cc:348] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.699609 30431 tablet_service.cc:1467] Processing CreateTablet for tablet a94fa2c973aa4e52b2a6edc69c594ec8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 08:19:46.701282 30483 raft_consensus.cc:374] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:46.707388 30431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a94fa2c973aa4e52b2a6edc69c594ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.709240 30432 tablet_service.cc:1467] Processing CreateTablet for tablet 3609240032904a1191b886666109ffd9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 08:19:46.710608 30276 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd62f0603a487bb8b63859cce5f2c4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 08:19:46.710801 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3609240032904a1191b886666109ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.712383 30483 raft_consensus.cc:729] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:46.713716 30351 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd62f0603a487bb8b63859cce5f2c4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 08:19:46.714192 30351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd62f0603a487bb8b63859cce5f2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.715255 30354 tablet_service.cc:1467] Processing CreateTablet for tablet af3cd710facb49a19984c4a447033a41 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 08:19:46.715907 30276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd62f0603a487bb8b63859cce5f2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.719159 30356 tablet_service.cc:1467] Processing CreateTablet for tablet dbcb66f8a5d74601b1e0f156d06e30f4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 08:19:46.716017 30483 consensus_queue.cc:260] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.720948 30354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af3cd710facb49a19984c4a447033a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.723927 30357 tablet_service.cc:1467] Processing CreateTablet for tablet a5b04d480698434e9842efbe6fdf0038 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 08:19:46.724968 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 951a8b753a7940cdb6e831be5bb8c3e1 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 08:19:46.725445 30485 tablet_bootstrap.cc:654] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.725535 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951a8b753a7940cdb6e831be5bb8c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.732648 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb66f8a5d74601b1e0f156d06e30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.743355 30350 tablet_service.cc:1467] Processing CreateTablet for tablet a94fa2c973aa4e52b2a6edc69c594ec8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 08:19:46.744022 30278 tablet_service.cc:1467] Processing CreateTablet for tablet a5b04d480698434e9842efbe6fdf0038 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 08:19:46.744468 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b04d480698434e9842efbe6fdf0038. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.745214 30484 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:46.746245 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5b04d480698434e9842efbe6fdf0038. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.749292 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0b3dae38b54620abb75200b4b421ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 08:19:46.751811 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a94fa2c973aa4e52b2a6edc69c594ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.752709 30484 ts_tablet_manager.cc:1367] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.144s user 0.011s sys 0.001s
I20240502 08:19:46.752842 30485 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:46.752986 30485 ts_tablet_manager.cc:1367] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.112s user 0.007s sys 0.013s
I20240502 08:19:46.755095 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0b3dae38b54620abb75200b4b421ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.757628 30353 tablet_service.cc:1467] Processing CreateTablet for tablet 03bb20d8df564ad582b1211921a3eeb9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 08:19:46.760231 30275 tablet_service.cc:1467] Processing CreateTablet for tablet dbcb66f8a5d74601b1e0f156d06e30f4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 08:19:46.760886 30281 tablet_service.cc:1467] Processing CreateTablet for tablet af3cd710facb49a19984c4a447033a41 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 08:19:46.765833 30429 tablet_service.cc:1467] Processing CreateTablet for tablet d51ec2cb58b4422ea5872093467ddd3d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 08:19:46.767294 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bb20d8df564ad582b1211921a3eeb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.769693 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb66f8a5d74601b1e0f156d06e30f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.776180 30429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51ec2cb58b4422ea5872093467ddd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.777534 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af3cd710facb49a19984c4a447033a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.778584 30282 tablet_service.cc:1467] Processing CreateTablet for tablet 03bb20d8df564ad582b1211921a3eeb9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 08:19:46.779575 30483 ts_tablet_manager.cc:1398] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.103s user 0.017s sys 0.030s
I20240502 08:19:46.779781 30468 heartbeater.cc:503] Master 127.28.130.190:36393 was elected leader, sending a full tablet report...
I20240502 08:19:46.780530 30280 tablet_service.cc:1467] Processing CreateTablet for tablet a94fa2c973aa4e52b2a6edc69c594ec8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 08:19:46.782774 30282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bb20d8df564ad582b1211921a3eeb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.783495 30483 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:46.783779 30359 tablet_service.cc:1467] Processing CreateTablet for tablet 3609240032904a1191b886666109ffd9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 08:19:46.784216 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3609240032904a1191b886666109ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.786587 30352 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0b3dae38b54620abb75200b4b421ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 08:19:46.786990 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0b3dae38b54620abb75200b4b421ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.788523 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a94fa2c973aa4e52b2a6edc69c594ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.788911 30485 raft_consensus.cc:348] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.793301 30485 raft_consensus.cc:374] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:46.794147 30358 tablet_service.cc:1467] Processing CreateTablet for tablet 951a8b753a7940cdb6e831be5bb8c3e1 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 08:19:46.797370 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951a8b753a7940cdb6e831be5bb8c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.797399 30433 tablet_service.cc:1467] Processing CreateTablet for tablet 3bee358532964d899a5a3d6494b391e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 08:19:46.802116 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bee358532964d899a5a3d6494b391e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.806555 30484 raft_consensus.cc:348] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.807387 30283 tablet_service.cc:1467] Processing CreateTablet for tablet 3609240032904a1191b886666109ffd9 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 08:19:46.808094 30426 tablet_service.cc:1467] Processing CreateTablet for tablet a811b43b5d634c76b4c138b5e36878b4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 08:19:46.808552 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a811b43b5d634c76b4c138b5e36878b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.808655 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3609240032904a1191b886666109ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.809568 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 951a8b753a7940cdb6e831be5bb8c3e1 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 08:19:46.809128 30484 raft_consensus.cc:374] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:46.811286 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951a8b753a7940cdb6e831be5bb8c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.813429 30485 raft_consensus.cc:729] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:46.815191 30284 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0b3dae38b54620abb75200b4b421ec (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 08:19:46.815657 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0b3dae38b54620abb75200b4b421ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.818213 30355 tablet_service.cc:1467] Processing CreateTablet for tablet d51ec2cb58b4422ea5872093467ddd3d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 08:19:46.818933 30485 consensus_queue.cc:260] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.821272 30488 raft_consensus.cc:482] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:46.822388 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3c3b43f2cb49d1b17c900a85280c29 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 08:19:46.822326 30488 raft_consensus.cc:504] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.824122 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51ec2cb58b4422ea5872093467ddd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.824484 30484 raft_consensus.cc:729] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:46.824627 30277 tablet_service.cc:1467] Processing CreateTablet for tablet d51ec2cb58b4422ea5872093467ddd3d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 08:19:46.830258 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3c3b43f2cb49d1b17c900a85280c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.832319 30488 leader_election.cc:288] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:46.832360 30351 tablet_service.cc:1467] Processing CreateTablet for tablet 3bee358532964d899a5a3d6494b391e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 08:19:46.836210 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51ec2cb58b4422ea5872093467ddd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.836287 30431 tablet_service.cc:1467] Processing CreateTablet for tablet 1c18a897201c4587a6900e05c5dd5b2f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 08:19:46.827275 30484 consensus_queue.cc:260] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.838055 30351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bee358532964d899a5a3d6494b391e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.841842 30431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c18a897201c4587a6900e05c5dd5b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.842514 30319 heartbeater.cc:503] Master 127.28.130.190:36393 was elected leader, sending a full tablet report...
I20240502 08:19:46.847195 30424 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3fee88d46743d783de24a43f035574 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 08:19:46.855360 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3fee88d46743d783de24a43f035574. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.856112 30427 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 08:19:46.864221 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.865132 30485 ts_tablet_manager.cc:1398] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.093s user 0.013s sys 0.010s
I20240502 08:19:46.871114 30483 tablet_bootstrap.cc:654] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.874545 30485 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:46.881762 30356 tablet_service.cc:1467] Processing CreateTablet for tablet a811b43b5d634c76b4c138b5e36878b4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 08:19:46.882339 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a811b43b5d634c76b4c138b5e36878b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.885403 30484 ts_tablet_manager.cc:1398] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.131s user 0.012s sys 0.021s
I20240502 08:19:46.885457 30490 raft_consensus.cc:482] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:46.885690 30394 heartbeater.cc:503] Master 127.28.130.190:36393 was elected leader, sending a full tablet report...
I20240502 08:19:46.885643 30490 raft_consensus.cc:504] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.886612 30484 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:46.886880 30490 leader_election.cc:288] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:46.893244 30491 raft_consensus.cc:482] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:46.893469 30491 raft_consensus.cc:504] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:46.894834 30491 leader_election.cc:288] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:46.918987 30276 tablet_service.cc:1467] Processing CreateTablet for tablet 3bee358532964d899a5a3d6494b391e2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 08:19:46.919517 30276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bee358532964d899a5a3d6494b391e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.922425 30350 tablet_service.cc:1467] Processing CreateTablet for tablet 1c18a897201c4587a6900e05c5dd5b2f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 08:19:46.922983 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c18a897201c4587a6900e05c5dd5b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.927006 30357 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3c3b43f2cb49d1b17c900a85280c29 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20240502 08:19:46.925204 30469 tablet.cc:2369] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 08:19:46.931277 30485 tablet_bootstrap.cc:654] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.942288 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 93a5263941344036a18c7993a0bf88f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 08:19:46.942799 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a5263941344036a18c7993a0bf88f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.944348 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3c3b43f2cb49d1b17c900a85280c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.954473 30484 tablet_bootstrap.cc:654] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:46.955549 30359 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3fee88d46743d783de24a43f035574 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 08:19:46.955945 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3fee88d46743d783de24a43f035574. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.951320 30432 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb63106daac4260b175d1e71f311d53 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 08:19:46.959698 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb63106daac4260b175d1e71f311d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.971354 30278 tablet_service.cc:1467] Processing CreateTablet for tablet a811b43b5d634c76b4c138b5e36878b4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 08:19:46.980386 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a811b43b5d634c76b4c138b5e36878b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.984011 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 08:19:46.985735 30275 tablet_service.cc:1467] Processing CreateTablet for tablet 6e3c3b43f2cb49d1b17c900a85280c29 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 08:19:46.985961 30352 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 08:19:46.986326 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.987543 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:46.991029 30282 tablet_service.cc:1467] Processing CreateTablet for tablet 1c18a897201c4587a6900e05c5dd5b2f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 08:19:46.991950 30353 tablet_service.cc:1467] Processing CreateTablet for tablet 93a5263941344036a18c7993a0bf88f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 08:19:46.996776 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e3c3b43f2cb49d1b17c900a85280c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.000173 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a5263941344036a18c7993a0bf88f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.001782 30282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c18a897201c4587a6900e05c5dd5b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.009095 30426 tablet_service.cc:1467] Processing CreateTablet for tablet 9e636180fea54536809d2981178098d8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 08:19:47.011576 30277 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3fee88d46743d783de24a43f035574 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 08:19:47.021531 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3fee88d46743d783de24a43f035574. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.021891 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.024616 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd11b5cffd4dcd9b40fea93fa400ad (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 08:19:47.026168 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e636180fea54536809d2981178098d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.027766 30283 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb63106daac4260b175d1e71f311d53 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 08:19:47.028292 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb63106daac4260b175d1e71f311d53. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 08:19:47.029554 30258 leader_election.cc:341] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.030941 30433 tablet_service.cc:1467] Processing CreateTablet for tablet b5ccb0ec312c41d19235303c97f9e9cc (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 08:19:47.031443 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ccb0ec312c41d19235303c97f9e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.033720 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd11b5cffd4dcd9b40fea93fa400ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.043367 30281 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 08:19:47.043745 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1bcd6afa6b4ac5a7afff0f8259bf38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.046604 30280 tablet_service.cc:1467] Processing CreateTablet for tablet 93a5263941344036a18c7993a0bf88f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 08:19:47.046931 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a5263941344036a18c7993a0bf88f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.049038 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 08:19:47.049360 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.054562 30429 tablet_service.cc:1467] Processing CreateTablet for tablet 357103558ce04e16867cd583542709d3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 08:19:47.054919 30429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357103558ce04e16867cd583542709d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.067849 30354 tablet_service.cc:1467] Processing CreateTablet for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 08:19:47.068432 30354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ffe2cc9dc1e4f0fafe4371c3b908e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.072135 30358 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb63106daac4260b175d1e71f311d53 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 08:19:47.072629 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb63106daac4260b175d1e71f311d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.075996 30359 tablet_service.cc:1467] Processing CreateTablet for tablet 9e636180fea54536809d2981178098d8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 08:19:47.084868 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e636180fea54536809d2981178098d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.086819 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 1acd903a90d04ba3b1496480bcbcc9d7 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 08:19:47.087219 30276 tablet_service.cc:1467] Processing CreateTablet for tablet 9e636180fea54536809d2981178098d8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 08:19:47.087370 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1acd903a90d04ba3b1496480bcbcc9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.088205 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 462907f615aa4a789ccac135ab693fdd (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 08:19:47.088536 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462907f615aa4a789ccac135ab693fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.089882 30284 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd11b5cffd4dcd9b40fea93fa400ad (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 08:19:47.090330 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd11b5cffd4dcd9b40fea93fa400ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.090299 30351 tablet_service.cc:1467] Processing CreateTablet for tablet 357103558ce04e16867cd583542709d3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 08:19:47.090752 30351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357103558ce04e16867cd583542709d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.091467 30431 tablet_service.cc:1467] Processing CreateTablet for tablet fbd976cd2d74411997117f936069dd1b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 08:19:47.092669 30356 tablet_service.cc:1467] Processing CreateTablet for tablet 76bd11b5cffd4dcd9b40fea93fa400ad (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 08:19:47.094609 30431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd976cd2d74411997117f936069dd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.096693 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76bd11b5cffd4dcd9b40fea93fa400ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.098820 30276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e636180fea54536809d2981178098d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.103569 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 309951d8b8b646988666292e5f6108e4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 08:19:47.104821 30484 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.104997 30484 ts_tablet_manager.cc:1367] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.218s user 0.015s sys 0.075s
I20240502 08:19:47.106882 30484 raft_consensus.cc:348] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.106990 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.107348 30484 raft_consensus.cc:374] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.107439 30484 raft_consensus.cc:729] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.109544 30355 tablet_service.cc:1467] Processing CreateTablet for tablet b5ccb0ec312c41d19235303c97f9e9cc (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 08:19:47.112246 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309951d8b8b646988666292e5f6108e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.113224 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ccb0ec312c41d19235303c97f9e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 08:19:47.116947 30406 leader_election.cc:341] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.120409 30484 consensus_queue.cc:260] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.124569 30427 tablet_service.cc:1467] Processing CreateTablet for tablet 228dc2bad04d4a719b5ef3a991de2873 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 08:19:47.124943 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228dc2bad04d4a719b5ef3a991de2873. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.128647 30424 tablet_service.cc:1467] Processing CreateTablet for tablet 76e2551cc79d4d17a61d49ae463e8764 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 08:19:47.131134 30483 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.131318 30483 ts_tablet_manager.cc:1367] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.351s user 0.059s sys 0.078s
I20240502 08:19:47.137219 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e2551cc79d4d17a61d49ae463e8764. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.141127 30484 ts_tablet_manager.cc:1398] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.036s user 0.001s sys 0.002s
I20240502 08:19:47.141458 30484 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.144759 30277 tablet_service.cc:1467] Processing CreateTablet for tablet b5ccb0ec312c41d19235303c97f9e9cc (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 08:19:47.145184 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ccb0ec312c41d19235303c97f9e9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.145141 30282 tablet_service.cc:1467] Processing CreateTablet for tablet 357103558ce04e16867cd583542709d3 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 08:19:47.145603 30282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357103558ce04e16867cd583542709d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.147764 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:47.148360 30408 leader_election.cc:341] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.148488 30408 leader_election.cc:302] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.150586 30357 tablet_service.cc:1467] Processing CreateTablet for tablet 462907f615aa4a789ccac135ab693fdd (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 08:19:47.150952 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462907f615aa4a789ccac135ab693fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.151476 30488 raft_consensus.cc:2726] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.153790 30353 tablet_service.cc:1467] Processing CreateTablet for tablet fbd976cd2d74411997117f936069dd1b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 08:19:47.154897 30485 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.155043 30485 ts_tablet_manager.cc:1367] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.289s user 0.010s sys 0.006s
I20240502 08:19:47.155063 30484 tablet_bootstrap.cc:654] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.157094 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd976cd2d74411997117f936069dd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.160385 30498 raft_consensus.cc:482] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.158718 30483 raft_consensus.cc:348] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.160527 30483 raft_consensus.cc:374] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.161520 30483 raft_consensus.cc:729] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.161792 30483 consensus_queue.cc:260] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.160527 30498 raft_consensus.cc:504] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.166743 30498 leader_election.cc:288] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.167444 30483 ts_tablet_manager.cc:1398] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.036s user 0.001s sys 0.002s
I20240502 08:19:47.167732 30483 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.169313 30426 tablet_service.cc:1467] Processing CreateTablet for tablet e57d2d37396543d6bbfb2e16edc75b7d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 08:19:47.172652 30485 raft_consensus.cc:348] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.172857 30485 raft_consensus.cc:374] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.172923 30485 raft_consensus.cc:729] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.173130 30485 consensus_queue.cc:260] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.173434 30350 tablet_service.cc:1467] Processing CreateTablet for tablet 1acd903a90d04ba3b1496480bcbcc9d7 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 08:19:47.173576 30485 ts_tablet_manager.cc:1398] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20240502 08:19:47.173787 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1acd903a90d04ba3b1496480bcbcc9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.173862 30485 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.174314 30432 tablet_service.cc:1467] Processing CreateTablet for tablet 9db55398254b48d6a96623ea9d563561 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 08:19:47.174739 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db55398254b48d6a96623ea9d563561. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.175412 30485 tablet_bootstrap.cc:654] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.177603 30483 tablet_bootstrap.cc:654] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.180083 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.180348 30352 tablet_service.cc:1467] Processing CreateTablet for tablet 309951d8b8b646988666292e5f6108e4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20240502 08:19:47.181246 30259 leader_election.cc:341] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.182438 30259 leader_election.cc:302] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:47.183146 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57d2d37396543d6bbfb2e16edc75b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.184193 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309951d8b8b646988666292e5f6108e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.187355 30490 raft_consensus.cc:2726] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.195822 30484 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.196007 30484 ts_tablet_manager.cc:1367] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.006s
I20240502 08:19:47.197341 30484 raft_consensus.cc:348] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.197535 30484 raft_consensus.cc:374] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.197602 30484 raft_consensus.cc:729] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.201856 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.202392 30433 tablet_service.cc:1467] Processing CreateTablet for tablet 54ead505545b4095a3a020bf338a7413 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20240502 08:19:47.202503 30332 leader_election.cc:341] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.202847 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54ead505545b4095a3a020bf338a7413. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.204821 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 462907f615aa4a789ccac135ab693fdd (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 08:19:47.203918 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.205385 30293 raft_consensus.cc:2454] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.206014 30281 tablet_service.cc:1467] Processing CreateTablet for tablet fbd976cd2d74411997117f936069dd1b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 08:19:47.206566 30332 leader_election.cc:302] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.206831 30498 raft_consensus.cc:2781] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.206921 30498 raft_consensus.cc:482] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.207005 30498 raft_consensus.cc:3037] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.207492 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462907f615aa4a789ccac135ab693fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.207885 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd976cd2d74411997117f936069dd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.209332 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.210243 30333 leader_election.cc:341] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.210453 30333 leader_election.cc:302] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339
I20240502 08:19:47.210506 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.213953 30280 tablet_service.cc:1467] Processing CreateTablet for tablet 1acd903a90d04ba3b1496480bcbcc9d7 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 08:19:47.214318 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1acd903a90d04ba3b1496480bcbcc9d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 08:19:47.214812 30333 leader_election.cc:341] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.215163 30283 tablet_service.cc:1467] Processing CreateTablet for tablet 309951d8b8b646988666292e5f6108e4 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 08:19:47.216435 30425 tablet_service.cc:1467] Processing CreateTablet for tablet 083a831f22ce4fad931d04fe213c14c0 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 08:19:47.217279 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083a831f22ce4fad931d04fe213c14c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.218914 30491 raft_consensus.cc:2726] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.220009 30484 consensus_queue.cc:260] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.220837 30484 ts_tablet_manager.cc:1398] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20240502 08:19:47.221182 30484 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.224551 30278 tablet_service.cc:1467] Processing CreateTablet for tablet 76e2551cc79d4d17a61d49ae463e8764 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 08:19:47.224927 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e2551cc79d4d17a61d49ae463e8764. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.227910 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309951d8b8b646988666292e5f6108e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.229339 30483 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.229471 30483 ts_tablet_manager.cc:1367] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.011s
I20240502 08:19:47.230684 30275 tablet_service.cc:1467] Processing CreateTablet for tablet 228dc2bad04d4a719b5ef3a991de2873 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 08:19:47.231666 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228dc2bad04d4a719b5ef3a991de2873. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.235738 30485 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.235881 30485 ts_tablet_manager.cc:1367] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.062s user 0.016s sys 0.002s
I20240502 08:19:47.238893 30356 tablet_service.cc:1467] Processing CreateTablet for tablet 76e2551cc79d4d17a61d49ae463e8764 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 08:19:47.238615 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 6b9f87872b36437fa743b50dd0c53ce8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 08:19:47.239606 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b9f87872b36437fa743b50dd0c53ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.239822 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e2551cc79d4d17a61d49ae463e8764. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 08:19:47.238055 30240 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 08:19:47.242530 30284 tablet_service.cc:1467] Processing CreateTablet for tablet e57d2d37396543d6bbfb2e16edc75b7d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 08:19:47.247241 30483 raft_consensus.cc:348] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.247429 30483 raft_consensus.cc:374] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.247486 30483 raft_consensus.cc:729] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.248082 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57d2d37396543d6bbfb2e16edc75b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.247982 30485 raft_consensus.cc:348] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.248277 30485 raft_consensus.cc:374] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.248354 30485 raft_consensus.cc:729] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.250299 30485 consensus_queue.cc:260] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.252049 30485 ts_tablet_manager.cc:1398] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20240502 08:19:47.253125 30485 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.254284 30483 consensus_queue.cc:260] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.256318 30483 ts_tablet_manager.cc:1398] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20240502 08:19:47.256552 30483 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.258527 30484 tablet_bootstrap.cc:654] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.260095 30276 tablet_service.cc:1467] Processing CreateTablet for tablet 9db55398254b48d6a96623ea9d563561 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 08:19:47.260476 30276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db55398254b48d6a96623ea9d563561. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.261463 30429 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d79a12da64188af3ca44fc7ff710f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 08:19:47.261797 30429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d79a12da64188af3ca44fc7ff710f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.262092 30354 tablet_service.cc:1467] Processing CreateTablet for tablet e57d2d37396543d6bbfb2e16edc75b7d (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 08:19:47.262465 30354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57d2d37396543d6bbfb2e16edc75b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.263278 30359 tablet_service.cc:1467] Processing CreateTablet for tablet 9db55398254b48d6a96623ea9d563561 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 08:19:47.263621 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db55398254b48d6a96623ea9d563561. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.263561 30498 raft_consensus.cc:504] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.264078 30430 tablet_service.cc:1467] Processing CreateTablet for tablet 6e47d748c7f24cba9f9e1ec2e91b8136 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 08:19:47.264204 30498 leader_election.cc:288] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.264442 30430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e47d748c7f24cba9f9e1ec2e91b8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.264833 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.265007 30293 raft_consensus.cc:3037] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.265616 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.265888 30358 tablet_service.cc:1467] Processing CreateTablet for tablet 228dc2bad04d4a719b5ef3a991de2873 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20240502 08:19:47.266009 30333 leader_election.cc:341] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.270082 30427 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2388853f54579b5971df47dc41618 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 08:19:47.270416 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2388853f54579b5971df47dc41618. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.273221 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228dc2bad04d4a719b5ef3a991de2873. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.274454 30424 tablet_service.cc:1467] Processing CreateTablet for tablet afe8cb04769648e88f7022b059fda39b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 08:19:47.274802 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe8cb04769648e88f7022b059fda39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.276219 30431 tablet_service.cc:1467] Processing CreateTablet for tablet 268827f2a34a425fb7e9c9d4c0f89a96 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 08:19:47.276598 30431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268827f2a34a425fb7e9c9d4c0f89a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.277549 30355 tablet_service.cc:1467] Processing CreateTablet for tablet 083a831f22ce4fad931d04fe213c14c0 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 08:19:47.278033 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083a831f22ce4fad931d04fe213c14c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.282097 30488 raft_consensus.cc:482] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.282317 30488 raft_consensus.cc:504] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.283623 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.285444 30488 leader_election.cc:288] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
W20240502 08:19:47.285617 30406 leader_election.cc:341] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.286377 30353 tablet_service.cc:1467] Processing CreateTablet for tablet 54ead505545b4095a3a020bf338a7413 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 08:19:47.287237 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54ead505545b4095a3a020bf338a7413. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.282577 30277 tablet_service.cc:1467] Processing CreateTablet for tablet 54ead505545b4095a3a020bf338a7413 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 08:19:47.287703 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54ead505545b4095a3a020bf338a7413. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.288659 30351 tablet_service.cc:1467] Processing CreateTablet for tablet 6b9f87872b36437fa743b50dd0c53ce8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 08:19:47.289042 30351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b9f87872b36437fa743b50dd0c53ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.289650 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:47.290513 30408 leader_election.cc:341] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.290630 30408 leader_election.cc:302] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.290886 30488 raft_consensus.cc:2726] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.292346 30293 raft_consensus.cc:2454] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.292728 30332 leader_election.cc:302] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.292974 30498 raft_consensus.cc:2781] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.293098 30498 raft_consensus.cc:686] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.293620 30488 raft_consensus.cc:482] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.293375 30498 consensus_queue.cc:237] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.304816 30488 raft_consensus.cc:504] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.318801 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:47.319519 30406 leader_election.cc:341] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.323267 30432 tablet_service.cc:1467] Processing CreateTablet for tablet 756a969437e74599a39cc9c2c38c7e9c (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 08:19:47.323993 30432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756a969437e74599a39cc9c2c38c7e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.325117 30433 tablet_service.cc:1467] Processing CreateTablet for tablet 6477f72163a94f1bb0381fb2f453f6f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 08:19:47.325620 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6477f72163a94f1bb0381fb2f453f6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.327462 30488 leader_election.cc:288] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.328119 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:47.328672 30408 leader_election.cc:341] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.328850 30408 leader_election.cc:302] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.329515 30488 raft_consensus.cc:2726] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.340353 30356 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d79a12da64188af3ca44fc7ff710f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 08:19:47.341575 30356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d79a12da64188af3ca44fc7ff710f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.343559 30485 tablet_bootstrap.cc:654] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.356544 30278 tablet_service.cc:1467] Processing CreateTablet for tablet 083a831f22ce4fad931d04fe213c14c0 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 08:19:47.357046 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083a831f22ce4fad931d04fe213c14c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.360244 30281 tablet_service.cc:1467] Processing CreateTablet for tablet 6b9f87872b36437fa743b50dd0c53ce8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 08:19:47.360591 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b9f87872b36437fa743b50dd0c53ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.363924 30352 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2388853f54579b5971df47dc41618 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 08:19:47.364291 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2388853f54579b5971df47dc41618. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.364949 30357 tablet_service.cc:1467] Processing CreateTablet for tablet afe8cb04769648e88f7022b059fda39b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 08:19:47.365283 30282 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d79a12da64188af3ca44fc7ff710f (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 08:19:47.365417 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe8cb04769648e88f7022b059fda39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.365617 30282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d79a12da64188af3ca44fc7ff710f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.366986 30275 tablet_service.cc:1467] Processing CreateTablet for tablet 6e47d748c7f24cba9f9e1ec2e91b8136 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 08:19:47.367326 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e47d748c7f24cba9f9e1ec2e91b8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.369182 30358 tablet_service.cc:1467] Processing CreateTablet for tablet 6e47d748c7f24cba9f9e1ec2e91b8136 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 08:19:47.369527 30358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e47d748c7f24cba9f9e1ec2e91b8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.369130 30426 tablet_service.cc:1467] Processing CreateTablet for tablet 1b52ae043b824aea9065625ac834ce22 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 08:19:47.370088 30426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b52ae043b824aea9065625ac834ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.372736 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 82577cbf65394ea1b821117762f25b58 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 08:19:47.375161 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82577cbf65394ea1b821117762f25b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.378943 30284 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2388853f54579b5971df47dc41618 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 08:19:47.379318 30284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2388853f54579b5971df47dc41618. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.379247 30425 tablet_service.cc:1467] Processing CreateTablet for tablet b172de19443e4af4a32e5ca5756794e8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 08:19:47.379812 30359 tablet_service.cc:1467] Processing CreateTablet for tablet 268827f2a34a425fb7e9c9d4c0f89a96 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 08:19:47.380200 30359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268827f2a34a425fb7e9c9d4c0f89a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.381342 30425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b172de19443e4af4a32e5ca5756794e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.382899 30280 tablet_service.cc:1467] Processing CreateTablet for tablet afe8cb04769648e88f7022b059fda39b (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 08:19:47.383276 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe8cb04769648e88f7022b059fda39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.383399 30483 tablet_bootstrap.cc:654] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.386521 30484 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.386663 30484 ts_tablet_manager.cc:1367] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.166s user 0.004s sys 0.003s
I20240502 08:19:47.387837 30190 catalog_manager.cc:5484] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.395169 30283 tablet_service.cc:1467] Processing CreateTablet for tablet 268827f2a34a425fb7e9c9d4c0f89a96 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 08:19:47.395582 30283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 268827f2a34a425fb7e9c9d4c0f89a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.402076 30278 tablet_service.cc:1467] Processing CreateTablet for tablet 756a969437e74599a39cc9c2c38c7e9c (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 08:19:47.402545 30278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756a969437e74599a39cc9c2c38c7e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.403889 30350 tablet_service.cc:1467] Processing CreateTablet for tablet 756a969437e74599a39cc9c2c38c7e9c (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 08:19:47.404465 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756a969437e74599a39cc9c2c38c7e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.405565 30355 tablet_service.cc:1467] Processing CreateTablet for tablet 6477f72163a94f1bb0381fb2f453f6f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 08:19:47.405875 30355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6477f72163a94f1bb0381fb2f453f6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.413437 30354 tablet_service.cc:1467] Processing CreateTablet for tablet 1b52ae043b824aea9065625ac834ce22 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 08:19:47.414048 30354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b52ae043b824aea9065625ac834ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.417237 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 6477f72163a94f1bb0381fb2f453f6f2 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 08:19:47.417654 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6477f72163a94f1bb0381fb2f453f6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.417687 30357 tablet_service.cc:1467] Processing CreateTablet for tablet 82577cbf65394ea1b821117762f25b58 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 08:19:47.418495 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82577cbf65394ea1b821117762f25b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.427126 30484 raft_consensus.cc:348] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.427356 30484 raft_consensus.cc:374] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.427417 30484 raft_consensus.cc:729] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.427608 30484 consensus_queue.cc:260] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.428120 30484 ts_tablet_manager.cc:1398] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.041s user 0.001s sys 0.000s
I20240502 08:19:47.428416 30484 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.435397 30277 tablet_service.cc:1467] Processing CreateTablet for tablet 1b52ae043b824aea9065625ac834ce22 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 08:19:47.436116 30277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b52ae043b824aea9065625ac834ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.439491 30352 tablet_service.cc:1467] Processing CreateTablet for tablet b172de19443e4af4a32e5ca5756794e8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 08:19:47.439810 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b172de19443e4af4a32e5ca5756794e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.442842 30281 tablet_service.cc:1467] Processing CreateTablet for tablet 82577cbf65394ea1b821117762f25b58 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 08:19:47.443720 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82577cbf65394ea1b821117762f25b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.447640 30275 tablet_service.cc:1467] Processing CreateTablet for tablet b172de19443e4af4a32e5ca5756794e8 (DEFAULT_TABLE table=test-workload [id=fd4e17b37cbb476384dc838c6f47b563]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 08:19:47.447903 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b172de19443e4af4a32e5ca5756794e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:47.470484 30498 raft_consensus.cc:482] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.470634 30498 raft_consensus.cc:504] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.471283 30498 leader_election.cc:288] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.471864 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.472550 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:47.472700 30333 leader_election.cc:341] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
W20240502 08:19:47.473096 30332 leader_election.cc:341] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.473220 30332 leader_election.cc:302] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339
I20240502 08:19:47.473663 30498 raft_consensus.cc:2726] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.477255 30484 tablet_bootstrap.cc:654] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.479075 30485 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.479241 30485 ts_tablet_manager.cc:1367] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.226s user 0.013s sys 0.027s
I20240502 08:19:47.480016 30485 raft_consensus.cc:348] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.480248 30485 raft_consensus.cc:374] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.480319 30485 raft_consensus.cc:729] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.480526 30485 consensus_queue.cc:260] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.484098 30485 ts_tablet_manager.cc:1398] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 08:19:47.484405 30485 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.490185 30485 tablet_bootstrap.cc:654] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.503651 30485 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.503827 30485 ts_tablet_manager.cc:1367] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20240502 08:19:47.504647 30485 raft_consensus.cc:348] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.504871 30485 raft_consensus.cc:374] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.504945 30485 raft_consensus.cc:729] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.505162 30485 consensus_queue.cc:260] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.505674 30485 ts_tablet_manager.cc:1398] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:47.505955 30485 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.521108 30498 raft_consensus.cc:482] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.521301 30498 raft_consensus.cc:504] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.521983 30498 leader_election.cc:288] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.522408 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.522629 30293 raft_consensus.cc:2454] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.523118 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.525413 30332 leader_election.cc:302] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.525719 30498 raft_consensus.cc:2781] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.525856 30498 raft_consensus.cc:482] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.525947 30498 raft_consensus.cc:3037] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:47.526064 30333 leader_election.cc:341] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.527650 30485 tablet_bootstrap.cc:654] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.529471 30498 raft_consensus.cc:504] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.531576 30484 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.531647 30485 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.531749 30484 ts_tablet_manager.cc:1367] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.103s user 0.012s sys 0.000s
I20240502 08:19:47.531782 30485 ts_tablet_manager.cc:1367] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.003s
I20240502 08:19:47.532550 30485 raft_consensus.cc:348] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.532577 30484 raft_consensus.cc:348] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.532739 30485 raft_consensus.cc:374] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.532792 30484 raft_consensus.cc:374] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.532824 30485 raft_consensus.cc:729] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.532871 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.532871 30484 raft_consensus.cc:729] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.533030 30293 raft_consensus.cc:3037] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.533056 30485 consensus_queue.cc:260] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.533174 30484 consensus_queue.cc:260] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.533697 30485 ts_tablet_manager.cc:1398] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.533792 30484 ts_tablet_manager.cc:1398] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.534010 30485 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.534107 30484 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.535745 30485 tablet_bootstrap.cc:654] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.535799 30293 raft_consensus.cc:2454] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.535977 30484 tablet_bootstrap.cc:654] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.536197 30498 leader_election.cc:288] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.536247 30332 leader_election.cc:302] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.536569 30483 tablet_bootstrap.cc:492] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.536684 30483 ts_tablet_manager.cc:1367] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.280s user 0.015s sys 0.046s
I20240502 08:19:47.536749 30491 raft_consensus.cc:2781] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.536872 30491 raft_consensus.cc:686] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.537825 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.537767 30491 consensus_queue.cc:237] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
W20240502 08:19:47.538581 30333 leader_election.cc:341] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.539180 30483 raft_consensus.cc:348] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.539351 30483 raft_consensus.cc:374] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.539410 30483 raft_consensus.cc:729] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.539618 30483 consensus_queue.cc:260] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.540084 30483 ts_tablet_manager.cc:1398] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 08:19:47.540547 30483 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.542382 30483 tablet_bootstrap.cc:654] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.541893 30192 catalog_manager.cc:5484] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.544353 30484 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.544512 30484 ts_tablet_manager.cc:1367] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.003s
I20240502 08:19:47.544867 30485 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.544988 30485 ts_tablet_manager.cc:1367] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.001s
I20240502 08:19:47.545326 30484 raft_consensus.cc:348] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.545565 30484 raft_consensus.cc:374] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.545591 30485 raft_consensus.cc:348] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.545763 30485 raft_consensus.cc:374] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.545828 30485 raft_consensus.cc:729] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.546020 30485 consensus_queue.cc:260] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.545684 30484 raft_consensus.cc:729] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.546428 30484 consensus_queue.cc:260] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.546981 30484 ts_tablet_manager.cc:1398] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:47.547258 30484 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.548372 30484 tablet_bootstrap.cc:654] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.549512 30485 ts_tablet_manager.cc:1398] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:47.549865 30483 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.549880 30485 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.549947 30483 ts_tablet_manager.cc:1367] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20240502 08:19:47.550575 30483 raft_consensus.cc:348] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.550704 30483 raft_consensus.cc:374] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.550737 30483 raft_consensus.cc:729] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.550884 30483 consensus_queue.cc:260] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.551282 30483 ts_tablet_manager.cc:1398] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 08:19:47.551546 30483 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.551695 30485 tablet_bootstrap.cc:654] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.553195 30483 tablet_bootstrap.cc:654] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.554139 30484 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.554419 30484 ts_tablet_manager.cc:1367] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240502 08:19:47.555436 30484 raft_consensus.cc:348] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.555748 30484 raft_consensus.cc:374] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.555873 30484 raft_consensus.cc:729] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.556322 30484 consensus_queue.cc:260] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.556953 30484 ts_tablet_manager.cc:1398] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.557442 30484 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.559401 30484 tablet_bootstrap.cc:654] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.560709 30483 tablet_bootstrap.cc:492] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.560837 30483 ts_tablet_manager.cc:1367] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20240502 08:19:47.561700 30484 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.561580 30483 raft_consensus.cc:348] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.561844 30484 ts_tablet_manager.cc:1367] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 08:19:47.561821 30483 raft_consensus.cc:374] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.561930 30483 raft_consensus.cc:729] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.561936 30485 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.562115 30485 ts_tablet_manager.cc:1367] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20240502 08:19:47.562196 30483 consensus_queue.cc:260] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.562490 30484 raft_consensus.cc:348] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.562649 30484 raft_consensus.cc:374] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.562700 30484 raft_consensus.cc:729] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.562690 30485 raft_consensus.cc:348] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.562942 30485 raft_consensus.cc:374] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.563014 30485 raft_consensus.cc:729] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.562971 30484 consensus_queue.cc:260] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.563418 30483 ts_tablet_manager.cc:1398] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.563516 30484 ts_tablet_manager.cc:1398] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.563690 30483 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.563709 30484 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.564800 30485 consensus_queue.cc:260] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.565328 30483 tablet_bootstrap.cc:654] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.565328 30484 tablet_bootstrap.cc:654] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.566134 30485 ts_tablet_manager.cc:1398] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 08:19:47.566408 30485 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.568022 30485 tablet_bootstrap.cc:654] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.569797 30485 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.569931 30485 ts_tablet_manager.cc:1367] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:47.570575 30485 raft_consensus.cc:348] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.570732 30485 raft_consensus.cc:374] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.570791 30485 raft_consensus.cc:729] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.571009 30485 consensus_queue.cc:260] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.571537 30485 ts_tablet_manager.cc:1398] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.571780 30485 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.573709 30485 tablet_bootstrap.cc:654] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.574278 30484 tablet_bootstrap.cc:492] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.575922 30484 ts_tablet_manager.cc:1367] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20240502 08:19:47.575392 30485 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.576110 30485 ts_tablet_manager.cc:1367] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:47.576609 30485 raft_consensus.cc:348] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.576751 30485 raft_consensus.cc:374] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.576817 30485 raft_consensus.cc:729] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.577040 30485 consensus_queue.cc:260] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.576756 30484 raft_consensus.cc:348] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.577345 30484 raft_consensus.cc:374] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.577430 30484 raft_consensus.cc:729] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.577620 30484 consensus_queue.cc:260] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.577849 30483 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.577965 30483 ts_tablet_manager.cc:1367] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20240502 08:19:47.578125 30484 ts_tablet_manager.cc:1398] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.578598 30485 ts_tablet_manager.cc:1398] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:47.578660 30483 raft_consensus.cc:348] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.578824 30483 raft_consensus.cc:374] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.578858 30485 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.578878 30483 raft_consensus.cc:729] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.579118 30483 consensus_queue.cc:260] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.579731 30483 ts_tablet_manager.cc:1398] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.579998 30483 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.581213 30484 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.581655 30483 tablet_bootstrap.cc:654] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.583161 30484 tablet_bootstrap.cc:654] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.583971 30485 tablet_bootstrap.cc:654] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.590605 30483 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.590839 30483 ts_tablet_manager.cc:1367] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20240502 08:19:47.591452 30485 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.591605 30485 ts_tablet_manager.cc:1367] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.002s
I20240502 08:19:47.591907 30484 tablet_bootstrap.cc:492] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.591763 30483 raft_consensus.cc:348] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.592022 30483 raft_consensus.cc:374] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.592052 30484 ts_tablet_manager.cc:1367] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20240502 08:19:47.592128 30483 raft_consensus.cc:729] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.592290 30485 raft_consensus.cc:348] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.592453 30485 raft_consensus.cc:374] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.592518 30485 raft_consensus.cc:729] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.592411 30483 consensus_queue.cc:260] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.592751 30485 consensus_queue.cc:260] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.592756 30484 raft_consensus.cc:348] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.593055 30484 raft_consensus.cc:374] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.593108 30484 raft_consensus.cc:729] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.593245 30483 ts_tablet_manager.cc:1398] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:47.593309 30484 consensus_queue.cc:260] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.593497 30483 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.593753 30484 ts_tablet_manager.cc:1398] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:19:47.594014 30484 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.594038 30485 ts_tablet_manager.cc:1398] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.594300 30485 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.595299 30483 tablet_bootstrap.cc:654] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.595683 30484 tablet_bootstrap.cc:654] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.596618 30485 tablet_bootstrap.cc:654] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.601351 30484 tablet_bootstrap.cc:492] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.601578 30484 ts_tablet_manager.cc:1367] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20240502 08:19:47.602298 30491 raft_consensus.cc:482] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.602443 30491 raft_consensus.cc:504] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.602672 30484 raft_consensus.cc:348] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.602926 30484 raft_consensus.cc:374] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.602993 30484 raft_consensus.cc:729] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.603192 30491 leader_election.cc:288] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.603296 30484 consensus_queue.cc:260] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.603821 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.604049 30442 raft_consensus.cc:2454] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.604105 30484 ts_tablet_manager.cc:1398] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:47.604476 30484 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.604720 30333 leader_election.cc:302] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.605273 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.605496 30293 raft_consensus.cc:2454] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.606835 30484 tablet_bootstrap.cc:654] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.607087 30485 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.607223 30485 ts_tablet_manager.cc:1367] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20240502 08:19:47.607960 30485 raft_consensus.cc:348] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.608170 30485 raft_consensus.cc:374] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.608242 30485 raft_consensus.cc:729] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.608510 30488 raft_consensus.cc:482] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.608453 30485 consensus_queue.cc:260] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.608633 30488 raft_consensus.cc:504] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.609125 30485 ts_tablet_manager.cc:1398] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.609395 30485 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.609457 30483 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.609573 30483 ts_tablet_manager.cc:1367] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.007s
I20240502 08:19:47.609632 30484 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.609730 30484 ts_tablet_manager.cc:1367] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 08:19:47.609829 30488 leader_election.cc:288] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.610339 30484 raft_consensus.cc:348] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.610311 30483 raft_consensus.cc:348] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.610531 30484 raft_consensus.cc:374] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.610545 30483 raft_consensus.cc:374] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.610606 30484 raft_consensus.cc:729] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.610637 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6c16bf46b1422393e430d5d836323a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.610719 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6c16bf46b1422393e430d5d836323a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.610816 30369 raft_consensus.cc:2454] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:47.610874 30293 raft_consensus.cc:2454] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:47.610836 30484 consensus_queue.cc:260] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.611100 30498 raft_consensus.cc:2781] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.611109 30485 tablet_bootstrap.cc:654] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.611184 30498 raft_consensus.cc:482] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.611199 30408 leader_election.cc:302] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.611251 30498 raft_consensus.cc:3037] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.610621 30483 raft_consensus.cc:729] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.611793 30483 consensus_queue.cc:260] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.613431 30488 raft_consensus.cc:2781] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.613536 30488 raft_consensus.cc:482] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.613615 30488 raft_consensus.cc:3037] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.614997 30498 raft_consensus.cc:504] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.616353 30498 leader_election.cc:288] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.616792 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.616986 30484 ts_tablet_manager.cc:1398] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240502 08:19:47.617017 30442 raft_consensus.cc:3037] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.617360 30484 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.618933 30483 ts_tablet_manager.cc:1398] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20240502 08:19:47.619495 30484 tablet_bootstrap.cc:654] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.619689 30485 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.619838 30485 ts_tablet_manager.cc:1367] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20240502 08:19:47.620002 30483 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.620414 30442 raft_consensus.cc:2454] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.620718 30485 raft_consensus.cc:348] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.621021 30485 raft_consensus.cc:374] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.621088 30333 leader_election.cc:302] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.621095 30485 raft_consensus.cc:729] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.621500 30485 consensus_queue.cc:260] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.621789 30483 tablet_bootstrap.cc:654] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.621896 30498 raft_consensus.cc:2781] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.621990 30498 raft_consensus.cc:686] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.622345 30485 ts_tablet_manager.cc:1398] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:47.622258 30498 consensus_queue.cc:237] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.622721 30485 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.623698 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1c63644a39642eeae800e736bdfebe3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.623924 30293 raft_consensus.cc:3037] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.624840 30485 tablet_bootstrap.cc:654] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.627525 30488 raft_consensus.cc:504] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.630528 30483 tablet_bootstrap.cc:492] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.633484 30483 ts_tablet_manager.cc:1367] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.001s
I20240502 08:19:47.634050 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6c16bf46b1422393e430d5d836323a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.634126 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6c16bf46b1422393e430d5d836323a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.634219 30294 raft_consensus.cc:3037] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.634245 30369 raft_consensus.cc:3037] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.634606 30483 raft_consensus.cc:348] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.634851 30483 raft_consensus.cc:374] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.631503 30485 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.634917 30488 leader_election.cc:288] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.632781 30293 raft_consensus.cc:2454] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.635054 30485 ts_tablet_manager.cc:1367] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20240502 08:19:47.635994 30485 raft_consensus.cc:348] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.636217 30485 raft_consensus.cc:374] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.636276 30485 raft_consensus.cc:729] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.636534 30485 consensus_queue.cc:260] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.634917 30483 raft_consensus.cc:729] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.637532 30483 consensus_queue.cc:260] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.637692 30294 raft_consensus.cc:2454] T bb6c16bf46b1422393e430d5d836323a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:47.638145 30485 ts_tablet_manager.cc:1398] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:47.638433 30536 raft_consensus.cc:482] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.638487 30485 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.638549 30536 raft_consensus.cc:504] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.639335 30536 leader_election.cc:288] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.639465 30483 ts_tablet_manager.cc:1398] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 08:19:47.639747 30483 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.640803 30485 tablet_bootstrap.cc:654] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.641376 30483 tablet_bootstrap.cc:654] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.642803 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.646917 30406 leader_election.cc:302] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.650257 30536 raft_consensus.cc:2781] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.650429 30536 raft_consensus.cc:686] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:47.650727 30536 consensus_queue.cc:237] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.651881 30484 tablet_bootstrap.cc:492] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.652036 30484 ts_tablet_manager.cc:1367] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.026s
I20240502 08:19:47.652387 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69fc8a31e074b6fb20a9070605c173e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.652643 30293 raft_consensus.cc:2379] T c69fc8a31e074b6fb20a9070605c173e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:47.652945 30484 raft_consensus.cc:348] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.653180 30484 raft_consensus.cc:374] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.653249 30484 raft_consensus.cc:729] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.653396 30406 leader_election.cc:302] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.653535 30484 consensus_queue.cc:260] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.653681 30490 raft_consensus.cc:482] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.653810 30490 raft_consensus.cc:504] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.654412 30488 raft_consensus.cc:3037] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.654605 30490 leader_election.cc:288] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.655232 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.655463 30442 raft_consensus.cc:2454] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.655896 30258 leader_election.cc:302] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.656656 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.656853 30368 raft_consensus.cc:2454] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.657243 30490 raft_consensus.cc:2781] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.657337 30490 raft_consensus.cc:482] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.657415 30490 raft_consensus.cc:3037] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.657986 30488 raft_consensus.cc:2726] T c69fc8a31e074b6fb20a9070605c173e P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.659000 30369 raft_consensus.cc:2454] T bb6c16bf46b1422393e430d5d836323a P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:47.661761 30490 raft_consensus.cc:504] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.663231 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.663429 30192 catalog_manager.cc:5484] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.664068 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3667036991403bab82f9f76c36b65b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.664258 30442 raft_consensus.cc:3037] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.663439 30369 raft_consensus.cc:3037] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.669147 30369 raft_consensus.cc:2454] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.670210 30442 raft_consensus.cc:2454] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.683755 30258 leader_election.cc:302] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.670660 30490 leader_election.cc:288] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.671803 30498 raft_consensus.cc:482] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.685497 30498 raft_consensus.cc:504] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.686563 30498 leader_election.cc:288] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.687459 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.687650 30490 raft_consensus.cc:482] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.687754 30442 raft_consensus.cc:2454] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.687809 30490 raft_consensus.cc:504] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.688251 30333 leader_election.cc:302] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.688616 30498 raft_consensus.cc:2781] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.688719 30498 raft_consensus.cc:482] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.688850 30498 raft_consensus.cc:3037] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.689950 30490 leader_election.cc:288] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.691577 30490 raft_consensus.cc:2781] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.692305 30490 raft_consensus.cc:686] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.692986 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5514ab40240743f8afcb372fcfa05f21" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.671651 30484 ts_tablet_manager.cc:1398] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20240502 08:19:47.693284 30368 raft_consensus.cc:2454] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.693830 30259 leader_election.cc:302] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.694268 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.694501 30294 raft_consensus.cc:2454] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.694998 30484 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.697463 30484 tablet_bootstrap.cc:654] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.697933 30498 raft_consensus.cc:504] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.703294 30498 leader_election.cc:288] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.704666 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.704936 30442 raft_consensus.cc:3037] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.706250 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fcfc7235394ad2bc4c421686b5ada5" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.706502 30294 raft_consensus.cc:3037] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.693151 30490 consensus_queue.cc:237] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.707120 30488 raft_consensus.cc:482] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.711297 30488 raft_consensus.cc:504] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.712641 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:47.713244 30406 leader_election.cc:341] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.714072 30488 leader_election.cc:288] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.714529 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:47.715091 30408 leader_election.cc:341] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.715234 30408 leader_election.cc:302] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.715790 30488 raft_consensus.cc:2726] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.717291 30442 raft_consensus.cc:2454] T e9fcfc7235394ad2bc4c421686b5ada5 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.717871 30333 leader_election.cc:302] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.718238 30498 raft_consensus.cc:2781] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.718420 30498 raft_consensus.cc:686] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.718782 30498 consensus_queue.cc:237] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.719559 30545 raft_consensus.cc:2781] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.720125 30545 raft_consensus.cc:482] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.720360 30545 raft_consensus.cc:3037] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.720325 30294 raft_consensus.cc:2454] T e9fcfc7235394ad2bc4c421686b5ada5 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.724517 30192 catalog_manager.cc:5484] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.727767 30545 raft_consensus.cc:504] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.729656 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5514ab40240743f8afcb372fcfa05f21" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.729900 30369 raft_consensus.cc:3037] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:47.730144 30258 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.130.131:34581, user_credentials={real_user=slave}} blocked reactor thread for 46435.8us
I20240502 08:19:47.730762 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5514ab40240743f8afcb372fcfa05f21" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.730979 30442 raft_consensus.cc:2454] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.733870 30369 raft_consensus.cc:2454] T 5514ab40240743f8afcb372fcfa05f21 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.734385 30259 leader_election.cc:302] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.735875 30545 leader_election.cc:288] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.736232 30545 raft_consensus.cc:2781] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.736577 30545 raft_consensus.cc:686] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.737215 30545 consensus_queue.cc:237] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.738198 30192 catalog_manager.cc:5484] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:47.744251 30498 consensus_queue.cc:1035] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:47.745442 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5514ab40240743f8afcb372fcfa05f21" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.745645 30442 raft_consensus.cc:3037] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.747419 30545 raft_consensus.cc:482] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.747730 30545 raft_consensus.cc:504] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.749061 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c348f2f255a349079a86b142579e6f10" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.749337 30369 raft_consensus.cc:2454] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.749751 30259 leader_election.cc:302] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.751084 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c348f2f255a349079a86b142579e6f10" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.751688 30258 leader_election.cc:341] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.752115 30545 leader_election.cc:288] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.752562 30545 raft_consensus.cc:2781] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.753019 30545 raft_consensus.cc:482] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.753252 30545 raft_consensus.cc:3037] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.750308 30442 raft_consensus.cc:2454] T 5514ab40240743f8afcb372fcfa05f21 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.760591 30498 raft_consensus.cc:482] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.760360 30192 catalog_manager.cc:5484] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.760759 30498 raft_consensus.cc:504] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.761564 30498 leader_election.cc:288] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.762285 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.762804 30333 leader_election.cc:341] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.765345 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.765573 30293 raft_consensus.cc:2454] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.766050 30332 leader_election.cc:302] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.766551 30498 raft_consensus.cc:2781] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.766654 30498 raft_consensus.cc:482] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.766754 30498 raft_consensus.cc:3037] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.767081 30484 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.767323 30484 ts_tablet_manager.cc:1367] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.013s
I20240502 08:19:47.768252 30484 raft_consensus.cc:348] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.768587 30484 raft_consensus.cc:374] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.768693 30484 raft_consensus.cc:729] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.769142 30484 consensus_queue.cc:260] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.759159 30545 raft_consensus.cc:504] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.770031 30498 raft_consensus.cc:504] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.770741 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c348f2f255a349079a86b142579e6f10" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.770920 30369 raft_consensus.cc:3037] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.772357 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.772545 30293 raft_consensus.cc:3037] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.773963 30369 raft_consensus.cc:2454] T c348f2f255a349079a86b142579e6f10 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.774544 30259 leader_election.cc:302] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.774895 30490 raft_consensus.cc:482] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.775063 30490 raft_consensus.cc:504] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.775725 30293 raft_consensus.cc:2454] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.776120 30332 leader_election.cc:302] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.776926 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.777397 30258 leader_election.cc:341] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.777581 30555 raft_consensus.cc:2781] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.777638 30490 leader_election.cc:288] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.777714 30555 raft_consensus.cc:686] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.777891 30490 raft_consensus.cc:2781] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.776142 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.778061 30490 raft_consensus.cc:686] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.778086 30369 raft_consensus.cc:2454] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.778437 30490 consensus_queue.cc:237] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.778529 30259 leader_election.cc:302] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.783288 30192 catalog_manager.cc:5484] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.784529 30550 raft_consensus.cc:2781] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.785315 30550 raft_consensus.cc:482] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.785753 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
W20240502 08:19:47.786509 30333 leader_election.cc:341] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.785876 30498 leader_election.cc:288] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.788545 30498 consensus_queue.cc:1035] T c69fc8a31e074b6fb20a9070605c173e P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:47.793455 30550 raft_consensus.cc:3037] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.795416 30483 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.795615 30483 ts_tablet_manager.cc:1367] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.156s user 0.025s sys 0.039s
I20240502 08:19:47.796707 30483 raft_consensus.cc:348] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.796988 30483 raft_consensus.cc:374] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.797065 30483 raft_consensus.cc:729] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.797361 30483 consensus_queue.cc:260] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.798099 30483 ts_tablet_manager.cc:1398] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240502 08:19:47.798489 30483 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.800704 30483 tablet_bootstrap.cc:654] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.803117 30483 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.803318 30483 ts_tablet_manager.cc:1367] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 08:19:47.804126 30483 raft_consensus.cc:348] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.804365 30483 raft_consensus.cc:374] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.804476 30483 raft_consensus.cc:729] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.804738 30483 consensus_queue.cc:260] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.805392 30483 ts_tablet_manager.cc:1398] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:47.778008 30555 consensus_queue.cc:237] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.805673 30483 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.806166 30550 raft_consensus.cc:504] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.806792 30550 leader_election.cc:288] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.807384 30483 tablet_bootstrap.cc:654] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.807389 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.807595 30443 raft_consensus.cc:3037] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.811161 30485 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.811232 30443 raft_consensus.cc:2454] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.811353 30485 ts_tablet_manager.cc:1367] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.173s user 0.076s sys 0.087s
I20240502 08:19:47.811808 30258 leader_election.cc:302] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.812295 30536 raft_consensus.cc:482] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.812309 30485 raft_consensus.cc:348] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.812470 30536 raft_consensus.cc:504] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.812635 30485 raft_consensus.cc:374] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.812696 30485 raft_consensus.cc:729] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.812927 30485 consensus_queue.cc:260] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.813515 30485 ts_tablet_manager.cc:1398] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.813670 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.813860 30485 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.814754 30536 leader_election.cc:288] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:47.814936 30544 raft_consensus.cc:482] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.815078 30544 raft_consensus.cc:504] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.815891 30485 tablet_bootstrap.cc:654] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.816504 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.817070 30258 leader_election.cc:341] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.818670 30544 leader_election.cc:288] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.818850 30544 raft_consensus.cc:2781] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.818974 30544 raft_consensus.cc:686] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.819378 30544 consensus_queue.cc:237] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.825899 30485 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.826208 30485 ts_tablet_manager.cc:1367] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.012s user 0.012s sys 0.000s
W20240502 08:19:47.826860 30259 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.130.130:38055, user_credentials={real_user=slave}} blocked reactor thread for 48351.2us
I20240502 08:19:47.826898 30485 raft_consensus.cc:348] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.827097 30485 raft_consensus.cc:374] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.827160 30485 raft_consensus.cc:729] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.827406 30485 consensus_queue.cc:260] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.827899 30485 ts_tablet_manager.cc:1398] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.827863 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a130bd930dd34683b20eebf600797fee" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.828012 30369 raft_consensus.cc:3037] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.828157 30485 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.828526 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c348f2f255a349079a86b142579e6f10" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
W20240502 08:19:47.829066 30258 leader_election.cc:341] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.829469 30485 tablet_bootstrap.cc:654] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.829679 30545 leader_election.cc:288] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.830500 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ead734a2397f48ac8b7b82dbb0b3af91" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.830782 30294 raft_consensus.cc:2379] T ead734a2397f48ac8b7b82dbb0b3af91 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:47.831084 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.831277 30368 raft_consensus.cc:2454] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.832805 30192 catalog_manager.cc:5484] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.833648 30550 raft_consensus.cc:482] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.833815 30550 raft_consensus.cc:504] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.835090 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.835702 30258 leader_election.cc:341] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.835901 30550 leader_election.cc:288] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.837631 30369 raft_consensus.cc:2454] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.839048 30406 leader_election.cc:302] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:47.839413 30536 raft_consensus.cc:3037] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.841228 30192 catalog_manager.cc:5484] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.842065 30484 ts_tablet_manager.cc:1398] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.075s user 0.004s sys 0.003s
I20240502 08:19:47.842502 30484 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.844450 30484 tablet_bootstrap.cc:654] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.846169 30536 raft_consensus.cc:2726] T ead734a2397f48ac8b7b82dbb0b3af91 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.846972 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.847235 30369 raft_consensus.cc:2454] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.847688 30259 leader_election.cc:302] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.848028 30544 raft_consensus.cc:2781] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.848140 30544 raft_consensus.cc:482] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.848235 30544 raft_consensus.cc:3037] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.848569 30259 leader_election.cc:302] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.850569 30490 raft_consensus.cc:2781] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.850651 30490 raft_consensus.cc:482] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.850720 30490 raft_consensus.cc:3037] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.851598 30192 catalog_manager.cc:5484] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.851807 30544 raft_consensus.cc:504] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.853127 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
W20240502 08:19:47.853749 30258 leader_election.cc:341] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.853140 30490 raft_consensus.cc:504] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.854683 30490 leader_election.cc:288] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.854835 30490 raft_consensus.cc:482] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.854977 30490 raft_consensus.cc:504] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.855682 30490 leader_election.cc:288] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.856583 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.856599 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.857120 30441 raft_consensus.cc:2454] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
W20240502 08:19:47.857663 30258 leader_election.cc:341] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.857877 30258 leader_election.cc:302] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.858172 30490 raft_consensus.cc:2781] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.858273 30490 raft_consensus.cc:482] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.858367 30490 raft_consensus.cc:3037] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.860802 30485 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.860961 30485 ts_tablet_manager.cc:1367] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.020s
I20240502 08:19:47.861646 30485 raft_consensus.cc:348] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.861837 30485 raft_consensus.cc:374] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.861923 30485 raft_consensus.cc:729] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.862154 30485 consensus_queue.cc:260] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.861856 30490 raft_consensus.cc:504] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.862728 30485 ts_tablet_manager.cc:1398] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:47.862820 30490 leader_election.cc:288] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.863241 30544 leader_election.cc:288] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.863708 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.863873 30369 raft_consensus.cc:3037] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.866483 30369 raft_consensus.cc:2454] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.866900 30485 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.867079 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.867249 30369 raft_consensus.cc:3037] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.867427 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.867650 30442 raft_consensus.cc:3037] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.868351 30485 tablet_bootstrap.cc:654] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.869973 30369 raft_consensus.cc:2454] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.870815 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.871102 30369 raft_consensus.cc:2454] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:47.871253 30442 raft_consensus.cc:2454] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.871711 30258 leader_election.cc:302] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.871853 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff8e4936b3de44e4a7be94c80ae260e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.872112 30369 raft_consensus.cc:3037] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.872107 30550 raft_consensus.cc:2781] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.872334 30550 raft_consensus.cc:686] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.872705 30550 consensus_queue.cc:237] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.875449 30369 raft_consensus.cc:2454] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:47.875977 30259 leader_election.cc:302] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.876536 30259 leader_election.cc:302] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.876996 30545 raft_consensus.cc:2781] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.877187 30545 raft_consensus.cc:686] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.877429 30490 raft_consensus.cc:2781] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.877642 30490 raft_consensus.cc:686] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:47.877557 30545 consensus_queue.cc:237] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.878010 30490 consensus_queue.cc:237] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.881467 30483 tablet_bootstrap.cc:492] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.881731 30483 ts_tablet_manager.cc:1367] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.076s user 0.025s sys 0.044s
I20240502 08:19:47.882644 30484 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.882854 30484 ts_tablet_manager.cc:1367] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.001s
I20240502 08:19:47.882622 30483 raft_consensus.cc:348] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.883059 30483 raft_consensus.cc:374] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.883199 30483 raft_consensus.cc:729] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.883462 30483 consensus_queue.cc:260] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.883641 30484 raft_consensus.cc:348] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.883829 30484 raft_consensus.cc:374] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.883936 30484 raft_consensus.cc:729] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.883750 30192 catalog_manager.cc:5484] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.884261 30485 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.884171 30484 consensus_queue.cc:260] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.884615 30485 ts_tablet_manager.cc:1367] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.008s
I20240502 08:19:47.885257 30485 raft_consensus.cc:348] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.885529 30485 raft_consensus.cc:374] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.885677 30485 raft_consensus.cc:729] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.885969 30485 consensus_queue.cc:260] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.886603 30485 ts_tablet_manager.cc:1398] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.886677 30483 ts_tablet_manager.cc:1398] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 08:19:47.887048 30485 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.887207 30484 ts_tablet_manager.cc:1398] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:47.887912 30483 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.889156 30485 tablet_bootstrap.cc:654] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.889523 30483 tablet_bootstrap.cc:654] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.889719 30484 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.891569 30484 tablet_bootstrap.cc:654] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.892053 30536 raft_consensus.cc:482] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.892230 30536 raft_consensus.cc:504] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.893040 30536 leader_election.cc:288] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.894044 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bc60419b9e4b508a2a4dc549d6c27e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.895041 30191 catalog_manager.cc:5484] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.895958 30191 catalog_manager.cc:5484] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.897392 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bc60419b9e4b508a2a4dc549d6c27e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:47.897648 30369 raft_consensus.cc:2454] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:47.898202 30408 leader_election.cc:302] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.898380 30294 raft_consensus.cc:2454] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:47.902424 30536 raft_consensus.cc:2781] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.902581 30536 raft_consensus.cc:482] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.903048 30536 raft_consensus.cc:3037] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.909835 30536 raft_consensus.cc:504] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.911288 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bc60419b9e4b508a2a4dc549d6c27e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.912514 30294 raft_consensus.cc:3037] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.916332 30294 raft_consensus.cc:2454] T 98bc60419b9e4b508a2a4dc549d6c27e P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:47.916760 30550 raft_consensus.cc:482] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.917376 30550 raft_consensus.cc:504] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.918267 30550 leader_election.cc:288] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.919036 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:47.919667 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98bc60419b9e4b508a2a4dc549d6c27e" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:47.919880 30369 raft_consensus.cc:3037] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:47.920174 30258 leader_election.cc:341] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.919281 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:47.920881 30259 leader_election.cc:341] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.921101 30259 leader_election.cc:302] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:47.917104 30406 leader_election.cc:302] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:47.921847 30488 raft_consensus.cc:2781] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.922425 30550 raft_consensus.cc:2726] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:47.923718 30369 raft_consensus.cc:2454] T 98bc60419b9e4b508a2a4dc549d6c27e P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:47.924078 30488 raft_consensus.cc:686] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:47.924300 30536 leader_election.cc:288] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:47.924494 30488 consensus_queue.cc:237] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.925881 30483 tablet_bootstrap.cc:492] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.925961 30485 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.926138 30483 ts_tablet_manager.cc:1367] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.021s
I20240502 08:19:47.926142 30485 ts_tablet_manager.cc:1367] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.039s user 0.019s sys 0.016s
I20240502 08:19:47.926280 30484 tablet_bootstrap.cc:492] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.926576 30484 ts_tablet_manager.cc:1367] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.021s
I20240502 08:19:47.927125 30485 raft_consensus.cc:348] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.927384 30485 raft_consensus.cc:374] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.927317 30483 raft_consensus.cc:348] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.927492 30485 raft_consensus.cc:729] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.927565 30483 raft_consensus.cc:374] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.927693 30483 raft_consensus.cc:729] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.927735 30485 consensus_queue.cc:260] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.927965 30483 consensus_queue.cc:260] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.928314 30485 ts_tablet_manager.cc:1398] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:47.928462 30483 ts_tablet_manager.cc:1398] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:47.928769 30483 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.928712 30484 raft_consensus.cc:348] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.929034 30484 raft_consensus.cc:374] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.929174 30484 raft_consensus.cc:729] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.929222 30192 catalog_manager.cc:5484] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:47.929641 30484 consensus_queue.cc:260] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.930236 30484 ts_tablet_manager.cc:1398] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:47.930555 30483 tablet_bootstrap.cc:654] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.930863 30484 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.930864 30485 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.934391 30484 tablet_bootstrap.cc:654] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.934649 30485 tablet_bootstrap.cc:654] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.935416 30483 tablet_bootstrap.cc:492] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.935583 30483 ts_tablet_manager.cc:1367] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20240502 08:19:47.936554 30483 raft_consensus.cc:348] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.936856 30483 raft_consensus.cc:374] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.936987 30483 raft_consensus.cc:729] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.937283 30483 consensus_queue.cc:260] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.938019 30483 ts_tablet_manager.cc:1398] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:47.938695 30483 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.940412 30484 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.940505 30483 tablet_bootstrap.cc:654] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.940572 30484 ts_tablet_manager.cc:1367] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20240502 08:19:47.940511 30485 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.941546 30485 ts_tablet_manager.cc:1367] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20240502 08:19:47.941413 30484 raft_consensus.cc:348] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.941692 30484 raft_consensus.cc:374] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.941823 30484 raft_consensus.cc:729] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.942073 30484 consensus_queue.cc:260] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.942369 30485 raft_consensus.cc:348] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.942603 30485 raft_consensus.cc:374] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.942613 30484 ts_tablet_manager.cc:1398] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.942704 30485 raft_consensus.cc:729] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.942946 30484 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.942951 30485 consensus_queue.cc:260] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.943552 30483 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.943760 30485 ts_tablet_manager.cc:1398] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:47.943778 30483 ts_tablet_manager.cc:1367] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240502 08:19:47.944166 30485 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.944548 30483 raft_consensus.cc:348] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.944751 30483 raft_consensus.cc:374] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.944833 30483 raft_consensus.cc:729] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.945137 30483 consensus_queue.cc:260] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.945641 30483 ts_tablet_manager.cc:1398] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:19:47.945953 30483 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.946079 30485 tablet_bootstrap.cc:654] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.947580 30483 tablet_bootstrap.cc:654] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.949568 30484 tablet_bootstrap.cc:654] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.950737 30485 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.950786 30483 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.950896 30483 ts_tablet_manager.cc:1367] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20240502 08:19:47.950898 30485 ts_tablet_manager.cc:1367] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240502 08:19:47.951231 30484 tablet_bootstrap.cc:492] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.951385 30484 ts_tablet_manager.cc:1367] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240502 08:19:47.951642 30483 raft_consensus.cc:348] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.951665 30485 raft_consensus.cc:348] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.951890 30483 raft_consensus.cc:374] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.951929 30485 raft_consensus.cc:374] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.952010 30483 raft_consensus.cc:729] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.952060 30485 raft_consensus.cc:729] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.951927 30484 raft_consensus.cc:348] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.952306 30484 raft_consensus.cc:374] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.952397 30484 raft_consensus.cc:729] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.952302 30483 consensus_queue.cc:260] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.952299 30485 consensus_queue.cc:260] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.952630 30484 consensus_queue.cc:260] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.952847 30485 ts_tablet_manager.cc:1398] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:19:47.953065 30484 ts_tablet_manager.cc:1398] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:47.953212 30485 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.954520 30483 ts_tablet_manager.cc:1398] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 08:19:47.954676 30485 tablet_bootstrap.cc:654] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.954815 30483 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.955731 30555 raft_consensus.cc:482] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:47.955927 30555 raft_consensus.cc:504] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.956600 30555 leader_election.cc:288] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.956733 30483 tablet_bootstrap.cc:654] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.957374 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcb66f8a5d74601b1e0f156d06e30f4" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:47.957793 30333 leader_election.cc:341] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:47.957947 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcb66f8a5d74601b1e0f156d06e30f4" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:47.958144 30294 raft_consensus.cc:2454] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:47.958684 30332 leader_election.cc:302] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:47.959105 30483 tablet_bootstrap.cc:492] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.959260 30483 ts_tablet_manager.cc:1367] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 08:19:47.959945 30483 raft_consensus.cc:348] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.960165 30483 raft_consensus.cc:374] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.960247 30483 raft_consensus.cc:729] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.960476 30483 consensus_queue.cc:260] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.961027 30483 ts_tablet_manager.cc:1398] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:47.961346 30483 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:47.961900 30554 raft_consensus.cc:2781] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:47.962018 30554 raft_consensus.cc:482] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:47.962131 30554 raft_consensus.cc:3037] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.964689 30555 consensus_queue.cc:1035] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:47.964771 30554 raft_consensus.cc:504] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.965446 30554 leader_election.cc:288] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:47.965992 30484 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.966372 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcb66f8a5d74601b1e0f156d06e30f4" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:47.966611 30441 raft_consensus.cc:3037] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.966931 30483 tablet_bootstrap.cc:654] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.970791 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcb66f8a5d74601b1e0f156d06e30f4" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:47.970983 30294 raft_consensus.cc:3037] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:47.974519 30294 raft_consensus.cc:2454] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.975096 30332 leader_election.cc:302] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:47.975466 30554 raft_consensus.cc:2781] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:47.975653 30554 raft_consensus.cc:686] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:47.976028 30554 consensus_queue.cc:237] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.979045 30441 raft_consensus.cc:2454] T dbcb66f8a5d74601b1e0f156d06e30f4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:47.979156 30485 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:47.979326 30485 ts_tablet_manager.cc:1367] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.016s
I20240502 08:19:47.979688 30484 tablet_bootstrap.cc:654] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.990345 30192 catalog_manager.cc:5484] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:47.991601 30485 raft_consensus.cc:348] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.992005 30483 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:47.992194 30483 ts_tablet_manager.cc:1367] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.015s
I20240502 08:19:47.992221 30485 raft_consensus.cc:374] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.992309 30485 raft_consensus.cc:729] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.992635 30485 consensus_queue.cc:260] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.993189 30484 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:47.993227 30485 ts_tablet_manager.cc:1398] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20240502 08:19:47.993602 30485 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:47.994419 30484 ts_tablet_manager.cc:1367] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.000s
I20240502 08:19:47.994923 30555 consensus_queue.cc:1035] T ead734a2397f48ac8b7b82dbb0b3af91 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:47.995158 30484 raft_consensus.cc:348] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.995354 30485 tablet_bootstrap.cc:654] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:47.995344 30483 raft_consensus.cc:348] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.995591 30483 raft_consensus.cc:374] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.995363 30484 raft_consensus.cc:374] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:47.996600 30484 raft_consensus.cc:729] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.995736 30483 raft_consensus.cc:729] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:47.996945 30483 consensus_queue.cc:260] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.996896 30484 consensus_queue.cc:260] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:47.997608 30484 ts_tablet_manager.cc:1398] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:47.997959 30484 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:47.999665 30484 tablet_bootstrap.cc:654] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.001106 30483 ts_tablet_manager.cc:1398] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240502 08:19:48.003736 30483 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.006232 30483 tablet_bootstrap.cc:654] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.010213 30485 tablet_bootstrap.cc:492] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.010448 30485 ts_tablet_manager.cc:1367] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.014s
I20240502 08:19:48.011476 30485 raft_consensus.cc:348] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.011797 30485 raft_consensus.cc:374] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.011930 30485 raft_consensus.cc:729] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.012249 30485 consensus_queue.cc:260] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.013048 30485 ts_tablet_manager.cc:1398] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:48.013446 30485 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.015391 30485 tablet_bootstrap.cc:654] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.015726 30484 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.015904 30484 ts_tablet_manager.cc:1367] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.005s
I20240502 08:19:48.016146 30483 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.016326 30483 ts_tablet_manager.cc:1367] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20240502 08:19:48.016846 30484 raft_consensus.cc:348] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.017061 30484 raft_consensus.cc:374] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.017169 30483 raft_consensus.cc:348] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.017304 30484 raft_consensus.cc:729] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.017411 30483 raft_consensus.cc:374] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.017514 30483 raft_consensus.cc:729] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.017599 30485 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.017784 30485 ts_tablet_manager.cc:1367] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:48.017607 30484 consensus_queue.cc:260] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.017815 30483 consensus_queue.cc:260] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.018373 30483 ts_tablet_manager.cc:1398] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.018476 30485 raft_consensus.cc:348] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.018703 30485 raft_consensus.cc:374] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.018808 30485 raft_consensus.cc:729] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.019055 30485 consensus_queue.cc:260] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.019202 30554 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.019441 30483 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.019584 30485 ts_tablet_manager.cc:1398] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:48.019869 30485 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.020002 30484 ts_tablet_manager.cc:1398] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20240502 08:19:48.020316 30484 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.021307 30483 tablet_bootstrap.cc:654] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.021824 30485 tablet_bootstrap.cc:654] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.021852 30484 tablet_bootstrap.cc:654] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.034190 30488 raft_consensus.cc:482] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.034420 30488 raft_consensus.cc:504] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.035087 30488 leader_election.cc:288] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.035583 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a94fa2c973aa4e52b2a6edc69c594ec8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.035820 30369 raft_consensus.cc:2454] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.036247 30408 leader_election.cc:302] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.037037 30557 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.038321 30488 raft_consensus.cc:2781] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.038440 30488 raft_consensus.cc:482] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.038543 30488 raft_consensus.cc:3037] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.041368 30488 raft_consensus.cc:504] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.041883 30484 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.042130 30484 ts_tablet_manager.cc:1367] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20240502 08:19:48.042327 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a94fa2c973aa4e52b2a6edc69c594ec8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.042572 30293 raft_consensus.cc:3037] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.042584 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a94fa2c973aa4e52b2a6edc69c594ec8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.043182 30484 raft_consensus.cc:348] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.043437 30484 raft_consensus.cc:374] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.043568 30484 raft_consensus.cc:729] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.043979 30484 consensus_queue.cc:260] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.044268 30488 leader_election.cc:288] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.045958 30293 raft_consensus.cc:2454] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.042378 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a94fa2c973aa4e52b2a6edc69c594ec8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.046646 30369 raft_consensus.cc:3037] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.048033 30484 ts_tablet_manager.cc:1398] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20240502 08:19:48.050033 30369 raft_consensus.cc:2454] T a94fa2c973aa4e52b2a6edc69c594ec8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.050652 30408 leader_election.cc:302] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.051409 30488 raft_consensus.cc:2781] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.051723 30488 raft_consensus.cc:686] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.052099 30488 consensus_queue.cc:237] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.052508 30485 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.052664 30485 ts_tablet_manager.cc:1367] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.013s
I20240502 08:19:48.051496 30484 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.053486 30485 raft_consensus.cc:348] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.053716 30485 raft_consensus.cc:374] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.053823 30485 raft_consensus.cc:729] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.054081 30485 consensus_queue.cc:260] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.054688 30485 ts_tablet_manager.cc:1398] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.055075 30484 tablet_bootstrap.cc:654] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.056481 30483 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.056685 30483 ts_tablet_manager.cc:1367] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.037s user 0.015s sys 0.000s
I20240502 08:19:48.057731 30485 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.057648 30483 raft_consensus.cc:348] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.057972 30483 raft_consensus.cc:374] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.058110 30483 raft_consensus.cc:729] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.058414 30483 consensus_queue.cc:260] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.059003 30483 ts_tablet_manager.cc:1398] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.059360 30485 tablet_bootstrap.cc:654] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.059473 30483 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.061378 30483 tablet_bootstrap.cc:654] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.062592 30191 catalog_manager.cc:5484] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.067342 30485 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.067507 30485 ts_tablet_manager.cc:1367] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20240502 08:19:48.068192 30485 raft_consensus.cc:348] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.068416 30485 raft_consensus.cc:374] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.068499 30485 raft_consensus.cc:729] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.068727 30485 consensus_queue.cc:260] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.069306 30485 ts_tablet_manager.cc:1398] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:48.069981 30485 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.071386 30488 consensus_queue.cc:1035] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.071540 30485 tablet_bootstrap.cc:654] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.074606 30483 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.074779 30483 ts_tablet_manager.cc:1367] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20240502 08:19:48.075253 30484 tablet_bootstrap.cc:492] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.075397 30484 ts_tablet_manager.cc:1367] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.008s
I20240502 08:19:48.075548 30483 raft_consensus.cc:348] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.075757 30483 raft_consensus.cc:374] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.075831 30483 raft_consensus.cc:729] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.076077 30483 consensus_queue.cc:260] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.076422 30576 raft_consensus.cc:482] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.076556 30576 raft_consensus.cc:504] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.076709 30484 raft_consensus.cc:348] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.076941 30484 raft_consensus.cc:374] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.077021 30484 raft_consensus.cc:729] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.077385 30576 leader_election.cc:288] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.077287 30484 consensus_queue.cc:260] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.077934 30484 ts_tablet_manager.cc:1398] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.078224 30484 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.079461 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd62f0603a487bb8b63859cce5f2c4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.079672 30293 raft_consensus.cc:2454] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.080121 30406 leader_election.cc:302] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.080633 30536 raft_consensus.cc:2781] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.080757 30536 raft_consensus.cc:482] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.080870 30536 raft_consensus.cc:3037] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.080732 30488 consensus_queue.cc:1035] T bb6c16bf46b1422393e430d5d836323a P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.081140 30484 tablet_bootstrap.cc:654] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.082461 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd62f0603a487bb8b63859cce5f2c4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.082644 30369 raft_consensus.cc:2454] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.086279 30576 raft_consensus.cc:482] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.086422 30576 raft_consensus.cc:504] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.086838 30483 ts_tablet_manager.cc:1398] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240502 08:19:48.087221 30576 leader_election.cc:288] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.088078 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bb20d8df564ad582b1211921a3eeb9" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.088336 30294 raft_consensus.cc:2454] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.090190 30406 leader_election.cc:302] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.090539 30488 raft_consensus.cc:2781] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.090623 30488 raft_consensus.cc:482] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.090695 30488 raft_consensus.cc:3037] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.092883 30485 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.094480 30485 ts_tablet_manager.cc:1367] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.005s
I20240502 08:19:48.094688 30483 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.095374 30485 raft_consensus.cc:348] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.098423 30485 raft_consensus.cc:374] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.098548 30485 raft_consensus.cc:729] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.098812 30485 consensus_queue.cc:260] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.099368 30485 ts_tablet_manager.cc:1398] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 08:19:48.099748 30488 raft_consensus.cc:504] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.100544 30485 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.097968 30483 tablet_bootstrap.cc:654] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.100853 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bb20d8df564ad582b1211921a3eeb9" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.101115 30294 raft_consensus.cc:3037] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.102625 30485 tablet_bootstrap.cc:654] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.103752 30294 raft_consensus.cc:2454] T 03bb20d8df564ad582b1211921a3eeb9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.103963 30536 raft_consensus.cc:504] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.104598 30536 leader_election.cc:288] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.105301 30485 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.105461 30485 ts_tablet_manager.cc:1367] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 08:19:48.106019 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bb20d8df564ad582b1211921a3eeb9" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.106230 30368 raft_consensus.cc:2454] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.107107 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd62f0603a487bb8b63859cce5f2c4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.107349 30368 raft_consensus.cc:3037] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.108785 30483 tablet_bootstrap.cc:492] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.108975 30483 ts_tablet_manager.cc:1367] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.004s
I20240502 08:19:48.109158 30406 leader_election.cc:302] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.109776 30488 leader_election.cc:288] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.109944 30488 raft_consensus.cc:2781] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.109778 30483 raft_consensus.cc:348] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.110045 30488 raft_consensus.cc:686] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.110517 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd62f0603a487bb8b63859cce5f2c4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.110785 30293 raft_consensus.cc:3037] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.110926 30488 consensus_queue.cc:237] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.106245 30485 raft_consensus.cc:348] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.111476 30485 raft_consensus.cc:374] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.111544 30485 raft_consensus.cc:729] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.111743 30485 consensus_queue.cc:260] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.112310 30485 ts_tablet_manager.cc:1398] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 08:19:48.114846 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bb20d8df564ad582b1211921a3eeb9" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.115075 30369 raft_consensus.cc:3037] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.119056 30369 raft_consensus.cc:2454] T 03bb20d8df564ad582b1211921a3eeb9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.120134 30368 raft_consensus.cc:2454] T 76bd62f0603a487bb8b63859cce5f2c4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.120476 30485 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.120535 30408 leader_election.cc:302] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.120726 30293 raft_consensus.cc:2454] T 76bd62f0603a487bb8b63859cce5f2c4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.120931 30608 raft_consensus.cc:2781] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.121182 30608 raft_consensus.cc:686] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.110527 30483 raft_consensus.cc:374] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.121671 30483 raft_consensus.cc:729] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.121502 30608 consensus_queue.cc:237] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.122087 30485 tablet_bootstrap.cc:654] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.121938 30483 consensus_queue.cc:260] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.122717 30483 ts_tablet_manager.cc:1398] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20240502 08:19:48.122992 30483 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.123771 30484 tablet_bootstrap.cc:492] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.123942 30484 ts_tablet_manager.cc:1367] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.046s user 0.025s sys 0.016s
I20240502 08:19:48.124367 30483 tablet_bootstrap.cc:654] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.124790 30484 raft_consensus.cc:348] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.125094 30484 raft_consensus.cc:374] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.125226 30484 raft_consensus.cc:729] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.125545 30484 consensus_queue.cc:260] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.129828 30484 ts_tablet_manager.cc:1398] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 08:19:48.130343 30192 catalog_manager.cc:5484] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.131657 30484 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.133677 30484 tablet_bootstrap.cc:654] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.135577 30483 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.135708 30483 ts_tablet_manager.cc:1367] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20240502 08:19:48.136405 30483 raft_consensus.cc:348] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.136549 30483 raft_consensus.cc:374] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.136607 30483 raft_consensus.cc:729] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.136831 30485 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.136821 30483 consensus_queue.cc:260] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.136982 30485 ts_tablet_manager.cc:1367] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.008s
I20240502 08:19:48.137339 30483 ts_tablet_manager.cc:1398] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.137496 30485 raft_consensus.cc:348] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.137672 30483 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.137670 30485 raft_consensus.cc:374] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.137778 30485 raft_consensus.cc:729] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.137974 30485 consensus_queue.cc:260] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.138581 30484 tablet_bootstrap.cc:492] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.138718 30484 ts_tablet_manager.cc:1367] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20240502 08:19:48.139096 30483 tablet_bootstrap.cc:654] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.139314 30484 raft_consensus.cc:348] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.139524 30484 raft_consensus.cc:374] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.139592 30484 raft_consensus.cc:729] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.139814 30484 consensus_queue.cc:260] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.139763 30192 catalog_manager.cc:5484] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.141167 30484 ts_tablet_manager.cc:1398] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.141423 30484 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.141510 30485 ts_tablet_manager.cc:1398] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:48.142779 30484 tablet_bootstrap.cc:654] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.144567 30485 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.145892 30550 consensus_queue.cc:1035] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.146593 30485 tablet_bootstrap.cc:654] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.148895 30484 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.149040 30484 ts_tablet_manager.cc:1367] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20240502 08:19:48.149904 30484 raft_consensus.cc:348] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.150149 30484 raft_consensus.cc:374] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.150200 30484 raft_consensus.cc:729] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.150513 30484 consensus_queue.cc:260] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.152735 30484 ts_tablet_manager.cc:1398] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:48.153064 30484 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.154929 30484 tablet_bootstrap.cc:654] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.158509 30550 raft_consensus.cc:482] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.158672 30550 raft_consensus.cc:504] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.159418 30550 leader_election.cc:288] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.159950 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.160179 30368 raft_consensus.cc:2454] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.160197 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.160449 30441 raft_consensus.cc:2454] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.160789 30259 leader_election.cc:302] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.161149 30544 consensus_queue.cc:1035] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.161406 30550 raft_consensus.cc:2781] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.161505 30550 raft_consensus.cc:482] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.161585 30550 raft_consensus.cc:3037] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.170850 30483 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.171000 30483 ts_tablet_manager.cc:1367] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.003s
I20240502 08:19:48.171123 30484 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.171252 30484 ts_tablet_manager.cc:1367] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20240502 08:19:48.171624 30483 raft_consensus.cc:348] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.171769 30483 raft_consensus.cc:374] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.171826 30483 raft_consensus.cc:729] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.171785 30484 raft_consensus.cc:348] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.171963 30484 raft_consensus.cc:374] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.172019 30484 raft_consensus.cc:729] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.172072 30483 consensus_queue.cc:260] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.172187 30484 consensus_queue.cc:260] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.172595 30483 ts_tablet_manager.cc:1398] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.172645 30484 ts_tablet_manager.cc:1398] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 08:19:48.172912 30484 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.173483 30483 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.173929 30550 raft_consensus.cc:504] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.174332 30484 tablet_bootstrap.cc:654] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.174978 30483 tablet_bootstrap.cc:654] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.175550 30441 raft_consensus.cc:3037] T c348f2f255a349079a86b142579e6f10 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.179575 30608 raft_consensus.cc:482] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.179739 30608 raft_consensus.cc:504] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.180438 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.180596 30608 leader_election.cc:288] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.180678 30443 raft_consensus.cc:3037] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.181708 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ae42e94e344ecfaaed26222ccc9b86" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.181941 30367 raft_consensus.cc:3037] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.184513 30443 raft_consensus.cc:2454] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.185165 30258 leader_election.cc:302] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.185536 30556 raft_consensus.cc:2781] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.185642 30367 raft_consensus.cc:2454] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.185688 30556 raft_consensus.cc:686] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.186236 30556 consensus_queue.cc:237] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.186475 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.188303 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ac192fb53234cb0938ea6ff4eea665a" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.188463 30608 raft_consensus.cc:482] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.188654 30293 raft_consensus.cc:2379] T 1ac192fb53234cb0938ea6ff4eea665a P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:48.188643 30608 raft_consensus.cc:504] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.189286 30406 leader_election.cc:302] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.189563 30608 leader_election.cc:288] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.189760 30608 raft_consensus.cc:3037] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.190261 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.191823 30550 leader_election.cc:288] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.193439 30608 raft_consensus.cc:2726] T 1ac192fb53234cb0938ea6ff4eea665a P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.194238 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e373972ec8f24e08b2b6a68c8c4db8b8" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.194551 30369 raft_consensus.cc:2379] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:48.195044 30408 leader_election.cc:302] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.195602 30488 raft_consensus.cc:3037] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.200117 30557 consensus_queue.cc:1035] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.200325 30488 raft_consensus.cc:2726] T e373972ec8f24e08b2b6a68c8c4db8b8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.202483 30545 consensus_queue.cc:1035] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.202716 30490 consensus_queue.cc:1035] T c348f2f255a349079a86b142579e6f10 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.204892 30558 consensus_queue.cc:1035] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.173187 30485 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.219763 30485 ts_tablet_manager.cc:1367] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.004s
I20240502 08:19:48.221653 30485 raft_consensus.cc:348] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.222013 30485 raft_consensus.cc:374] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.222124 30485 raft_consensus.cc:729] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.224691 30545 raft_consensus.cc:482] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.238922 30545 raft_consensus.cc:504] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.226101 30490 consensus_queue.cc:1035] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20240502 08:19:48.239884 30545 leader_election.cc:288] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.240402 30544 consensus_queue.cc:1035] T 5514ab40240743f8afcb372fcfa05f21 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.240757 30483 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.241008 30483 ts_tablet_manager.cc:1367] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.068s user 0.038s sys 0.025s
I20240502 08:19:48.241884 30483 raft_consensus.cc:348] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.242205 30483 raft_consensus.cc:374] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.242344 30483 raft_consensus.cc:729] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.222570 30485 consensus_queue.cc:260] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.242786 30483 consensus_queue.cc:260] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.243170 30485 ts_tablet_manager.cc:1398] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20240502 08:19:48.243474 30485 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.245041 30485 tablet_bootstrap.cc:654] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
W20240502 08:19:48.246013 30240 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 08:19:48.246399 30483 ts_tablet_manager.cc:1398] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 08:19:48.248942 30483 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.250039 30484 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.250209 30484 ts_tablet_manager.cc:1367] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.077s user 0.021s sys 0.053s
I20240502 08:19:48.246276 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.250955 30484 raft_consensus.cc:348] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
W20240502 08:19:48.251596 30259 leader_election.cc:341] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.252328 30485 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.252143 30191 catalog_manager.cc:5484] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.252460 30485 ts_tablet_manager.cc:1367] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20240502 08:19:48.252487 30498 consensus_queue.cc:1035] T 1ac192fb53234cb0938ea6ff4eea665a P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.253046 30485 raft_consensus.cc:348] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.253224 30485 raft_consensus.cc:374] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.253968 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:48.254612 30258 leader_election.cc:341] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.254786 30258 leader_election.cc:302] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.253317 30485 raft_consensus.cc:729] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.255189 30485 consensus_queue.cc:260] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.255411 30544 raft_consensus.cc:2726] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.255690 30608 raft_consensus.cc:482] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.255872 30608 raft_consensus.cc:504] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.256160 30483 tablet_bootstrap.cc:654] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.256443 30485 ts_tablet_manager.cc:1398] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:48.256726 30608 leader_election.cc:288] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.256778 30484 raft_consensus.cc:374] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.256920 30484 raft_consensus.cc:729] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.257144 30484 consensus_queue.cc:260] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.259258 30484 ts_tablet_manager.cc:1398] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240502 08:19:48.259521 30484 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.259637 30558 raft_consensus.cc:482] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.259770 30558 raft_consensus.cc:504] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.259955 30555 consensus_queue.cc:1035] T e9fcfc7235394ad2bc4c421686b5ada5 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.260385 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.260360 30558 leader_election.cc:288] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.260579 30368 raft_consensus.cc:2454] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.261109 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.261317 30294 raft_consensus.cc:2454] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.261943 30406 leader_election.cc:302] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.262611 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3609240032904a1191b886666109ffd9" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.262794 30294 raft_consensus.cc:2454] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.262971 30488 raft_consensus.cc:2781] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.263064 30488 raft_consensus.cc:482] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.263180 30488 raft_consensus.cc:3037] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.263698 30332 leader_election.cc:302] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.264292 30557 raft_consensus.cc:2781] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.264408 30557 raft_consensus.cc:482] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.264518 30557 raft_consensus.cc:3037] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.265669 30488 raft_consensus.cc:504] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.266749 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.266948 30294 raft_consensus.cc:3037] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.268024 30557 raft_consensus.cc:504] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.268812 30483 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.268766 30550 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.269001 30483 ts_tablet_manager.cc:1367] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.003s
I20240502 08:19:48.269266 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3609240032904a1191b886666109ffd9" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.269446 30292 raft_consensus.cc:3037] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.269743 30294 raft_consensus.cc:2454] T a5b04d480698434e9842efbe6fdf0038 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.269807 30483 raft_consensus.cc:348] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.270054 30483 raft_consensus.cc:374] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.270159 30406 leader_election.cc:302] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.270406 30488 leader_election.cc:288] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.270493 30608 raft_consensus.cc:2781] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.270535 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5b04d480698434e9842efbe6fdf0038" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.270619 30608 raft_consensus.cc:686] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.270702 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3609240032904a1191b886666109ffd9" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.270712 30369 raft_consensus.cc:3037] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.270900 30443 raft_consensus.cc:2454] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.270931 30608 consensus_queue.cc:237] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.272089 30292 raft_consensus.cc:2454] T 3609240032904a1191b886666109ffd9 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.272505 30332 leader_election.cc:302] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.272540 30558 raft_consensus.cc:482] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.272691 30558 raft_consensus.cc:504] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.272754 30555 raft_consensus.cc:2781] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.272902 30555 raft_consensus.cc:686] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.273130 30555 consensus_queue.cc:237] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.273331 30558 leader_election.cc:288] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.273937 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af3cd710facb49a19984c4a447033a41" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.274106 30443 raft_consensus.cc:2454] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.274502 30333 leader_election.cc:302] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.274811 30554 raft_consensus.cc:2781] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.274928 30554 raft_consensus.cc:482] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.275027 30554 raft_consensus.cc:3037] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.275490 30557 leader_election.cc:288] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.275789 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3609240032904a1191b886666109ffd9" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.276007 30443 raft_consensus.cc:3037] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.277531 30554 raft_consensus.cc:504] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.278740 30443 raft_consensus.cc:2454] T 3609240032904a1191b886666109ffd9 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.278964 30554 leader_election.cc:288] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.279538 30556 raft_consensus.cc:482] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.279881 30545 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.279974 30556 raft_consensus.cc:504] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.273250 30369 raft_consensus.cc:2454] T a5b04d480698434e9842efbe6fdf0038 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.281642 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af3cd710facb49a19984c4a447033a41" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.256770 30485 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.283973 30292 raft_consensus.cc:2454] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.270160 30483 raft_consensus.cc:729] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.286432 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af3cd710facb49a19984c4a447033a41" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.292912 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af3cd710facb49a19984c4a447033a41" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.293265 30294 raft_consensus.cc:3037] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.295239 30443 raft_consensus.cc:3037] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.295954 30483 consensus_queue.cc:260] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.295318 30556 leader_election.cc:288] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.299404 30555 raft_consensus.cc:482] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.299548 30555 raft_consensus.cc:504] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.300221 30443 raft_consensus.cc:2454] T af3cd710facb49a19984c4a447033a41 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.301731 30333 leader_election.cc:302] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.302011 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a5263941344036a18c7993a0bf88f2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.303027 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a5263941344036a18c7993a0bf88f2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.303257 30440 raft_consensus.cc:2454] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.305987 30557 raft_consensus.cc:482] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.309919 30483 ts_tablet_manager.cc:1398] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20240502 08:19:48.310115 30294 raft_consensus.cc:2454] T af3cd710facb49a19984c4a447033a41 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.310295 30483 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.310454 30555 leader_election.cc:288] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.310657 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951a8b753a7940cdb6e831be5bb8c3e1" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.310914 30293 raft_consensus.cc:2454] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.311136 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951a8b753a7940cdb6e831be5bb8c3e1" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.311388 30439 raft_consensus.cc:2454] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.311807 30333 leader_election.cc:302] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.311936 30483 tablet_bootstrap.cc:654] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.312232 30555 raft_consensus.cc:2781] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.312368 30555 raft_consensus.cc:482] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.312503 30555 raft_consensus.cc:3037] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.313012 30485 tablet_bootstrap.cc:654] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.313815 30483 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.313999 30483 ts_tablet_manager.cc:1367] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:48.314527 30554 raft_consensus.cc:2781] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.314378 30192 catalog_manager.cc:5484] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.314567 30556 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20240502 08:19:48.314693 30555 raft_consensus.cc:504] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.314944 30554 raft_consensus.cc:686] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.314913 30483 raft_consensus.cc:348] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.315121 30483 raft_consensus.cc:374] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.315228 30483 raft_consensus.cc:729] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.315384 30554 consensus_queue.cc:237] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.315495 30483 consensus_queue.cc:260] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.315680 30557 raft_consensus.cc:504] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.315819 30484 tablet_bootstrap.cc:654] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.316072 30483 ts_tablet_manager.cc:1398] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.316267 30557 leader_election.cc:288] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.316433 30483 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339: Bootstrap starting.
W20240502 08:19:48.315529 30259 leader_election.cc:341] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.319582 30483 tablet_bootstrap.cc:654] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.320641 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951a8b753a7940cdb6e831be5bb8c3e1" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.320887 30294 raft_consensus.cc:3037] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.321483 30485 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.321683 30485 ts_tablet_manager.cc:1367] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.001s
I20240502 08:19:48.322398 30485 raft_consensus.cc:348] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.322659 30485 raft_consensus.cc:374] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.322750 30485 raft_consensus.cc:729] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.323004 30485 consensus_queue.cc:260] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.323689 30483 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.323834 30483 ts_tablet_manager.cc:1367] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 08:19:48.324465 30483 raft_consensus.cc:348] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.324641 30483 raft_consensus.cc:374] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.324739 30483 raft_consensus.cc:729] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.324954 30483 consensus_queue.cc:260] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.325480 30488 raft_consensus.cc:482] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.325656 30488 raft_consensus.cc:504] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.326259 30488 leader_election.cc:288] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.326931 30483 ts_tablet_manager.cc:1398] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 08:19:48.327230 30483 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.319526 30258 leader_election.cc:302] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:48.324807 30294 raft_consensus.cc:2454] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.333529 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951a8b753a7940cdb6e831be5bb8c3e1" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.333532 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0b3dae38b54620abb75200b4b421ec" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.333679 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0b3dae38b54620abb75200b4b421ec" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.333837 30293 raft_consensus.cc:2454] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.337117 30556 raft_consensus.cc:2781] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.337479 30555 leader_election.cc:288] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.337617 30332 leader_election.cc:302] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.337280 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.338691 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.340338 30442 raft_consensus.cc:3037] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.340371 30441 raft_consensus.cc:2454] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.341003 30483 tablet_bootstrap.cc:654] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.342135 30490 raft_consensus.cc:482] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.343659 30485 ts_tablet_manager.cc:1398] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.017s user 0.000s sys 0.003s
I20240502 08:19:48.350620 30490 raft_consensus.cc:504] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.353924 30545 raft_consensus.cc:482] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.358438 30556 raft_consensus.cc:482] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.358633 30545 raft_consensus.cc:504] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.361583 30484 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.364574 30608 raft_consensus.cc:482] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.365446 30555 raft_consensus.cc:2781] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.365638 30555 raft_consensus.cc:686] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.366024 30555 consensus_queue.cc:237] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.367439 30292 raft_consensus.cc:2454] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
W20240502 08:19:48.367483 30408 leader_election.cc:341] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.367739 30440 raft_consensus.cc:3037] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.369539 30332 leader_election.cc:302] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.371609 30557 raft_consensus.cc:2781] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.371723 30557 raft_consensus.cc:482] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.371815 30556 raft_consensus.cc:3037] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.372794 30557 raft_consensus.cc:3037] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.376904 30442 raft_consensus.cc:2454] T 951a8b753a7940cdb6e831be5bb8c3e1 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.380106 30545 leader_election.cc:288] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.382171 30554 consensus_queue.cc:1035] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240502 08:19:48.385998 30484 ts_tablet_manager.cc:1367] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.102s user 0.000s sys 0.016s
I20240502 08:19:48.386457 30557 raft_consensus.cc:504] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.391428 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51ec2cb58b4422ea5872093467ddd3d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.392933 30484 raft_consensus.cc:348] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.393594 30650 raft_consensus.cc:482] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.394389 30650 raft_consensus.cc:504] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.394904 30369 raft_consensus.cc:2454] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.395361 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.396818 30483 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.397017 30259 leader_election.cc:302] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.396730 30608 raft_consensus.cc:504] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.397625 30483 ts_tablet_manager.cc:1367] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.070s user 0.006s sys 0.005s
I20240502 08:19:48.397576 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.398288 30485 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.399242 30406 leader_election.cc:302] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:48.399580 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.400789 30536 raft_consensus.cc:482] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240502 08:19:48.401412 30258 leader_election.cc:341] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.403059 30555 consensus_queue.cc:1035] T dbcb66f8a5d74601b1e0f156d06e30f4 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.403081 30368 raft_consensus.cc:2454] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.404793 30608 leader_election.cc:288] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.407114 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0b3dae38b54620abb75200b4b421ec" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.407689 30408 leader_election.cc:302] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.408552 30556 raft_consensus.cc:504] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.408558 30653 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20240502 08:19:48.409098 30485 tablet_bootstrap.cc:654] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.409677 30483 raft_consensus.cc:348] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.411221 30556 leader_election.cc:288] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.411319 30557 leader_election.cc:288] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.411510 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0b3dae38b54620abb75200b4b421ec" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.411744 30291 raft_consensus.cc:3037] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.415257 30291 raft_consensus.cc:2454] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.415545 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51ec2cb58b4422ea5872093467ddd3d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.415669 30332 leader_election.cc:302] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.415772 30442 raft_consensus.cc:2454] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.415930 30557 raft_consensus.cc:2781] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.416129 30557 raft_consensus.cc:686] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.416404 30557 consensus_queue.cc:237] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.411260 30189 catalog_manager.cc:5484] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.418273 30484 raft_consensus.cc:374] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.418430 30484 raft_consensus.cc:729] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.419207 30490 leader_election.cc:288] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.419116 30651 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20240502 08:19:48.419164 30484 consensus_queue.cc:260] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.419369 30488 raft_consensus.cc:2781] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.419459 30488 raft_consensus.cc:482] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.419567 30488 raft_consensus.cc:3037] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.419730 30484 ts_tablet_manager.cc:1398] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20240502 08:19:48.420058 30484 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.421120 30484 tablet_bootstrap.cc:654] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.422569 30488 raft_consensus.cc:504] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.423058 30536 raft_consensus.cc:504] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.423643 30536 leader_election.cc:288] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
W20240502 08:19:48.423806 30259 leader_election.cc:341] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.423935 30259 leader_election.cc:302] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.424221 30651 raft_consensus.cc:2726] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.424795 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.425549 30608 raft_consensus.cc:2781] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.425665 30608 raft_consensus.cc:482] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.425792 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.425861 30647 raft_consensus.cc:2781] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.425964 30647 raft_consensus.cc:482] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.426110 30647 raft_consensus.cc:3037] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.426225 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a5263941344036a18c7993a0bf88f2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.424886 30650 leader_election.cc:288] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.425514 30441 raft_consensus.cc:3037] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.429911 30647 raft_consensus.cc:504] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.430430 30483 raft_consensus.cc:374] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.430557 30483 raft_consensus.cc:729] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.430866 30483 consensus_queue.cc:260] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.431202 30544 raft_consensus.cc:482] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.431365 30544 raft_consensus.cc:504] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.431792 30441 raft_consensus.cc:2454] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.432164 30544 leader_election.cc:288] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.432550 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.425802 30608 raft_consensus.cc:3037] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.433274 30483 ts_tablet_manager.cc:1398] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20240502 08:19:48.433691 30483 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.434981 30189 catalog_manager.cc:5484] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.435369 30608 raft_consensus.cc:504] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.435582 30483 tablet_bootstrap.cc:654] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.435568 30189 catalog_manager.cc:5484] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.436136 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a5263941344036a18c7993a0bf88f2" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.436357 30442 raft_consensus.cc:3037] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.436364 30189 catalog_manager.cc:5484] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.440443 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.441190 30608 leader_election.cc:288] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.441639 30647 leader_election.cc:288] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
W20240502 08:19:48.442272 30259 leader_election.cc:341] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
W20240502 08:19:48.442534 30406 leader_election.cc:341] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
W20240502 08:19:48.442534 30259 leader_election.cc:341] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.443109 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.443449 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.443560 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59692a88df104ec2ad428f6b097422ec" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.443751 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51ec2cb58b4422ea5872093467ddd3d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.443956 30365 raft_consensus.cc:3037] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:48.444245 30406 leader_election.cc:341] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.444527 30406 leader_election.cc:302] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.445376 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.445577 30367 raft_consensus.cc:3037] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.446991 30607 consensus_queue.cc:1035] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.447190 30484 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.447350 30484 ts_tablet_manager.cc:1367] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.002s
W20240502 08:19:48.447444 30258 leader_election.cc:341] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.447592 30258 leader_election.cc:302] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.448053 30484 raft_consensus.cc:348] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.448251 30484 raft_consensus.cc:374] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.448362 30484 raft_consensus.cc:729] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.448570 30647 raft_consensus.cc:2726] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.448863 30484 consensus_queue.cc:260] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.449426 30484 ts_tablet_manager.cc:1398] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.449743 30484 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.449847 30607 consensus_queue.cc:1035] T a94fa2c973aa4e52b2a6edc69c594ec8 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.451224 30484 tablet_bootstrap.cc:654] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.452736 30483 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.453112 30365 raft_consensus.cc:2454] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.453593 30483 ts_tablet_manager.cc:1367] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
W20240502 08:19:48.453883 30259 leader_election.cc:341] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.454437 30647 consensus_queue.cc:1035] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.455024 30259 leader_election.cc:302] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.455369 30650 raft_consensus.cc:2781] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.455055 30483 raft_consensus.cc:348] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.455523 30650 raft_consensus.cc:686] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.455564 30483 raft_consensus.cc:374] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.455651 30483 raft_consensus.cc:729] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.455799 30650 consensus_queue.cc:237] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.455857 30483 consensus_queue.cc:260] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.456447 30483 ts_tablet_manager.cc:1398] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:48.456784 30483 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.458438 30490 consensus_queue.cc:1035] T e373972ec8f24e08b2b6a68c8c4db8b8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.458585 30483 tablet_bootstrap.cc:654] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.459877 30490 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.448644 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d51ec2cb58b4422ea5872093467ddd3d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.462649 30438 raft_consensus.cc:3037] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.463326 30536 raft_consensus.cc:2726] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20240502 08:19:48.465569 30438 raft_consensus.cc:2454] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.469262 30367 raft_consensus.cc:2454] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.469664 30408 leader_election.cc:302] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.470132 30607 raft_consensus.cc:2781] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.470305 30607 raft_consensus.cc:686] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.470695 30607 consensus_queue.cc:237] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.471807 30557 raft_consensus.cc:482] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.471956 30557 raft_consensus.cc:504] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.472579 30557 leader_election.cc:288] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.473019 30483 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.473224 30483 ts_tablet_manager.cc:1367] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.007s
I20240502 08:19:48.473398 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:48.473850 30333 leader_election.cc:341] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.473747 30189 catalog_manager.cc:5484] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.474010 30483 raft_consensus.cc:348] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.474310 30483 raft_consensus.cc:374] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.474416 30483 raft_consensus.cc:729] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.474543 30442 raft_consensus.cc:2454] T 93a5263941344036a18c7993a0bf88f2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.474742 30483 consensus_queue.cc:260] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.474984 30258 leader_election.cc:302] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:48.475261 30650 raft_consensus.cc:2781] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.475383 30650 raft_consensus.cc:686] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.475474 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.475677 30650 consensus_queue.cc:237] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.475850 30484 tablet_bootstrap.cc:492] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.476006 30484 ts_tablet_manager.cc:1367] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20240502 08:19:48.475680 30441 raft_consensus.cc:2454] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.476558 30258 leader_election.cc:302] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:48.476673 30484 raft_consensus.cc:348] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.476884 30484 raft_consensus.cc:374] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.476975 30484 raft_consensus.cc:729] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.477005 30651 raft_consensus.cc:2781] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.477092 30651 raft_consensus.cc:482] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.477208 30651 raft_consensus.cc:3037] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.477258 30484 consensus_queue.cc:260] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.477914 30484 ts_tablet_manager.cc:1398] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.478209 30484 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.479828 30484 tablet_bootstrap.cc:654] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.479997 30651 raft_consensus.cc:504] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.481163 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.481531 30651 leader_election.cc:288] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.481374 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.482407 30439 raft_consensus.cc:3037] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.482597 30576 consensus_queue.cc:1035] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 08:19:48.482789 30259 leader_election.cc:341] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.484779 30483 ts_tablet_manager.cc:1398] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240502 08:19:48.485173 30483 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.485500 30439 raft_consensus.cc:2454] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.485908 30258 leader_election.cc:302] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:48.486321 30490 raft_consensus.cc:2781] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.486519 30490 raft_consensus.cc:686] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.486820 30490 consensus_queue.cc:237] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.487332 30483 tablet_bootstrap.cc:654] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.488922 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.489192 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bee358532964d899a5a3d6494b391e2" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.489567 30292 raft_consensus.cc:3037] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.489619 30367 raft_consensus.cc:3037] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.489941 30536 consensus_queue.cc:1035] T 98bc60419b9e4b508a2a4dc549d6c27e P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.492733 30292 raft_consensus.cc:2454] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.493207 30406 leader_election.cc:302] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.493571 30536 raft_consensus.cc:2781] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.488464 30488 leader_election.cc:288] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.494727 30536 raft_consensus.cc:686] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.495086 30536 consensus_queue.cc:237] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.500955 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.501259 30293 raft_consensus.cc:2454] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.501865 30332 leader_election.cc:302] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.502291 30558 raft_consensus.cc:2781] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.502446 30558 raft_consensus.cc:482] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.502558 30558 raft_consensus.cc:3037] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.493381 30367 raft_consensus.cc:2454] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.504765 30558 raft_consensus.cc:504] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.505476 30558 leader_election.cc:288] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.505795 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.506065 30291 raft_consensus.cc:3037] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.506304 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
W20240502 08:19:48.506841 30333 leader_election.cc:341] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.510604 30291 raft_consensus.cc:2454] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.511204 30332 leader_election.cc:302] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.511879 30558 raft_consensus.cc:2781] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.512202 30558 raft_consensus.cc:686] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.512674 30558 consensus_queue.cc:237] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.519131 30485 tablet_bootstrap.cc:492] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.519349 30485 ts_tablet_manager.cc:1367] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.169s user 0.007s sys 0.002s
I20240502 08:19:48.520300 30485 raft_consensus.cc:348] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.520576 30485 raft_consensus.cc:374] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.520686 30485 raft_consensus.cc:729] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.520994 30485 consensus_queue.cc:260] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.521720 30485 ts_tablet_manager.cc:1398] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:48.522095 30485 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.524806 30485 tablet_bootstrap.cc:654] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.525705 30483 tablet_bootstrap.cc:492] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.525890 30483 ts_tablet_manager.cc:1367] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.002s
I20240502 08:19:48.528179 30483 raft_consensus.cc:348] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.528415 30483 raft_consensus.cc:374] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.528537 30483 raft_consensus.cc:729] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.528425 30190 catalog_manager.cc:5484] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.528802 30483 consensus_queue.cc:260] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.529434 30483 ts_tablet_manager.cc:1398] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:48.529728 30483 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.532112 30484 tablet_bootstrap.cc:492] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.532305 30484 ts_tablet_manager.cc:1367] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.001s
I20240502 08:19:48.532109 30189 catalog_manager.cc:5484] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.533020 30484 raft_consensus.cc:348] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.533200 30484 raft_consensus.cc:374] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.533293 30484 raft_consensus.cc:729] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.533486 30484 consensus_queue.cc:260] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.532500 30485 tablet_bootstrap.cc:492] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.534150 30485 ts_tablet_manager.cc:1367] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20240502 08:19:48.534654 30484 ts_tablet_manager.cc:1398] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.534960 30484 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.534969 30485 raft_consensus.cc:348] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.535200 30485 raft_consensus.cc:374] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.535292 30485 raft_consensus.cc:729] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.535542 30485 consensus_queue.cc:260] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.536109 30485 ts_tablet_manager.cc:1398] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.536458 30485 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.536542 30484 tablet_bootstrap.cc:654] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.536203 30192 catalog_manager.cc:5484] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.537315 30483 tablet_bootstrap.cc:654] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.537747 30485 tablet_bootstrap.cc:654] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.541503 30484 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.541744 30484 ts_tablet_manager.cc:1367] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20240502 08:19:48.542793 30484 raft_consensus.cc:348] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.543107 30484 raft_consensus.cc:374] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.543198 30484 raft_consensus.cc:729] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.543700 30484 consensus_queue.cc:260] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.544098 30189 catalog_manager.cc:5484] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.544515 30484 ts_tablet_manager.cc:1398] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:48.544903 30484 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.546962 30484 tablet_bootstrap.cc:654] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.555212 30558 raft_consensus.cc:482] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.555398 30558 raft_consensus.cc:504] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.555660 30484 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.555816 30484 ts_tablet_manager.cc:1367] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20240502 08:19:48.556099 30558 leader_election.cc:288] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.556727 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.557010 30441 raft_consensus.cc:2454] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.557521 30333 leader_election.cc:302] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.557535 30484 raft_consensus.cc:348] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.557852 30558 raft_consensus.cc:2781] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.557922 30484 raft_consensus.cc:374] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.557699 30191 catalog_manager.cc:5484] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.557979 30558 raft_consensus.cc:482] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.558096 30484 raft_consensus.cc:729] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.558123 30558 raft_consensus.cc:3037] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.558339 30484 consensus_queue.cc:260] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.558842 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.559005 30484 ts_tablet_manager.cc:1398] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:48.559079 30291 raft_consensus.cc:2454] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.559141 30483 tablet_bootstrap.cc:492] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.559310 30484 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.559439 30483 ts_tablet_manager.cc:1367] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.013s
I20240502 08:19:48.560218 30483 raft_consensus.cc:348] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.560509 30483 raft_consensus.cc:374] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.560626 30483 raft_consensus.cc:729] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.560945 30483 consensus_queue.cc:260] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.561168 30484 tablet_bootstrap.cc:654] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.561113 30558 raft_consensus.cc:504] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.562045 30483 ts_tablet_manager.cc:1398] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.562109 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.562296 30291 raft_consensus.cc:3037] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.562546 30483 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.564213 30483 tablet_bootstrap.cc:654] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.564603 30485 tablet_bootstrap.cc:492] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.564754 30485 ts_tablet_manager.cc:1367] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.011s
I20240502 08:19:48.565289 30291 raft_consensus.cc:2454] T 1c18a897201c4587a6900e05c5dd5b2f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.565582 30485 raft_consensus.cc:348] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.565783 30485 raft_consensus.cc:374] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.565845 30332 leader_election.cc:302] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.565902 30485 raft_consensus.cc:729] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.566310 30485 consensus_queue.cc:260] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.566480 30555 raft_consensus.cc:2781] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.566649 30555 raft_consensus.cc:686] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.568545 30484 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.568737 30484 ts_tablet_manager.cc:1367] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20240502 08:19:48.568713 30555 consensus_queue.cc:237] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.569311 30484 raft_consensus.cc:348] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.569532 30484 raft_consensus.cc:374] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.569598 30484 raft_consensus.cc:729] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.569846 30484 consensus_queue.cc:260] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.570093 30650 raft_consensus.cc:482] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.570255 30650 raft_consensus.cc:504] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.570461 30484 ts_tablet_manager.cc:1398] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.570691 30484 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.571004 30650 leader_election.cc:288] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.571235 30608 raft_consensus.cc:482] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.571336 30608 raft_consensus.cc:504] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.571776 30608 leader_election.cc:288] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.572106 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.572227 30558 leader_election.cc:288] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.572852 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a811b43b5d634c76b4c138b5e36878b4" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.573027 30369 raft_consensus.cc:2379] T a811b43b5d634c76b4c138b5e36878b4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in current term 1: Already voted for candidate f40077f920074fffba17e847ebc10339 in this term.
I20240502 08:19:48.573038 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd11b5cffd4dcd9b40fea93fa400ad" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.573441 30365 raft_consensus.cc:2454] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.573909 30408 leader_election.cc:302] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.574239 30608 raft_consensus.cc:2781] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.574319 30608 raft_consensus.cc:482] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.574405 30608 raft_consensus.cc:3037] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.575142 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c18a897201c4587a6900e05c5dd5b2f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.575196 30258 leader_election.cc:302] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.575280 30441 raft_consensus.cc:3037] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.576462 30484 tablet_bootstrap.cc:654] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.577064 30608 raft_consensus.cc:504] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.578022 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd11b5cffd4dcd9b40fea93fa400ad" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.578563 30490 raft_consensus.cc:3037] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.579315 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd11b5cffd4dcd9b40fea93fa400ad" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.579535 30365 raft_consensus.cc:3037] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.583746 30365 raft_consensus.cc:2454] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.584259 30650 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.584568 30293 raft_consensus.cc:3037] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.585460 30408 leader_election.cc:302] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.585847 30536 raft_consensus.cc:2781] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.585976 30536 raft_consensus.cc:686] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.586345 30536 consensus_queue.cc:237] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.587394 30557 raft_consensus.cc:482] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.587522 30557 raft_consensus.cc:504] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.588091 30557 leader_election.cc:288] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.588866 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.590435 30293 raft_consensus.cc:2454] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.591562 30655 raft_consensus.cc:482] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.591730 30655 raft_consensus.cc:504] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
W20240502 08:19:48.591959 30333 leader_election.cc:341] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.592183 30650 raft_consensus.cc:482] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.592315 30650 raft_consensus.cc:504] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.592321 30655 leader_election.cc:288] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.593040 30650 leader_election.cc:288] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.593569 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3c3b43f2cb49d1b17c900a85280c29" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.593791 30369 raft_consensus.cc:2454] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.594377 30259 leader_election.cc:302] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.594686 30441 raft_consensus.cc:2454] T 1c18a897201c4587a6900e05c5dd5b2f P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.582268 30490 raft_consensus.cc:2726] T a811b43b5d634c76b4c138b5e36878b4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.595060 30490 raft_consensus.cc:2781] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.595144 30490 raft_consensus.cc:482] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.595237 30490 raft_consensus.cc:3037] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.595849 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3c3b43f2cb49d1b17c900a85280c29" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.596078 30439 raft_consensus.cc:2454] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.596356 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.596892 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.597167 30365 raft_consensus.cc:2454] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
W20240502 08:19:48.597225 30258 leader_election.cc:341] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.598057 30259 leader_election.cc:302] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.599268 30655 raft_consensus.cc:2781] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.599382 30655 raft_consensus.cc:482] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.599474 30655 raft_consensus.cc:3037] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.604255 30490 raft_consensus.cc:504] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.605727 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3c3b43f2cb49d1b17c900a85280c29" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.605978 30365 raft_consensus.cc:3037] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.606181 30189 catalog_manager.cc:5484] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.608358 30484 tablet_bootstrap.cc:492] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.608496 30484 ts_tablet_manager.cc:1367] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.011s
I20240502 08:19:48.609740 30484 raft_consensus.cc:348] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.609928 30484 raft_consensus.cc:374] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.609977 30484 raft_consensus.cc:729] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.609759 30365 raft_consensus.cc:2454] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.610460 30259 leader_election.cc:302] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.610869 30651 raft_consensus.cc:2781] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.610989 30651 raft_consensus.cc:686] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.611219 30651 consensus_queue.cc:237] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.613049 30556 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.613405 30655 raft_consensus.cc:504] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.614596 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.614774 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.614923 30367 raft_consensus.cc:3037] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:48.615021 30258 leader_election.cc:341] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.618407 30655 leader_election.cc:288] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.618618 30367 raft_consensus.cc:2454] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.619072 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76bd11b5cffd4dcd9b40fea93fa400ad" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.619329 30291 raft_consensus.cc:2362] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1. Re-sending same reply.
I20240502 08:19:48.584689 30608 leader_election.cc:288] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.619858 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.620098 30293 raft_consensus.cc:2379] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:48.620291 30484 consensus_queue.cc:260] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.620573 30332 leader_election.cc:302] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.620877 30484 ts_tablet_manager.cc:1398] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20240502 08:19:48.621099 30558 raft_consensus.cc:2726] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.622035 30484 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.621162 30608 consensus_queue.cc:1035] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240502 08:19:48.621189 30259 leader_election.cc:302] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.623404 30556 raft_consensus.cc:2781] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.623545 30556 raft_consensus.cc:686] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.623867 30556 consensus_queue.cc:237] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.628365 30189 catalog_manager.cc:5484] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.628942 30191 catalog_manager.cc:5484] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.632524 30608 consensus_queue.cc:1035] T 76bd62f0603a487bb8b63859cce5f2c4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.634661 30485 ts_tablet_manager.cc:1398] T 76bd11b5cffd4dcd9b40fea93fa400ad P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.070s user 0.009s sys 0.000s
I20240502 08:19:48.635020 30485 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.636968 30485 tablet_bootstrap.cc:654] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.640651 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e3c3b43f2cb49d1b17c900a85280c29" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.640924 30442 raft_consensus.cc:3037] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.644594 30484 tablet_bootstrap.cc:654] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.645552 30485 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.645694 30485 ts_tablet_manager.cc:1367] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 08:19:48.646422 30485 raft_consensus.cc:348] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.646612 30485 raft_consensus.cc:374] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.646698 30485 raft_consensus.cc:729] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.646875 30485 consensus_queue.cc:260] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.647415 30485 ts_tablet_manager.cc:1398] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:48.647656 30485 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.647519 30191 catalog_manager.cc:5484] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.648867 30485 tablet_bootstrap.cc:654] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.644680 30442 raft_consensus.cc:2454] T 6e3c3b43f2cb49d1b17c900a85280c29 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.644728 30490 leader_election.cc:288] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.658792 30483 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.659067 30483 ts_tablet_manager.cc:1367] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.097s user 0.036s sys 0.040s
I20240502 08:19:48.660578 30485 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.660703 30485 ts_tablet_manager.cc:1367] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.004s
I20240502 08:19:48.660673 30608 consensus_queue.cc:1035] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.661170 30483 raft_consensus.cc:348] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.661425 30483 raft_consensus.cc:374] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.661384 30485 raft_consensus.cc:348] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.661540 30483 raft_consensus.cc:729] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.661569 30485 raft_consensus.cc:374] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.661823 30485 raft_consensus.cc:729] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.662010 30485 consensus_queue.cc:260] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.662022 30483 consensus_queue.cc:260] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.662689 30483 ts_tablet_manager.cc:1398] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 08:19:48.662698 30485 ts_tablet_manager.cc:1398] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.663046 30485 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.663069 30483 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.664355 30485 tablet_bootstrap.cc:654] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.664882 30483 tablet_bootstrap.cc:654] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.667001 30484 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.667122 30484 ts_tablet_manager.cc:1367] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.009s
I20240502 08:19:48.667176 30483 tablet_bootstrap.cc:492] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.667300 30483 ts_tablet_manager.cc:1367] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:48.667887 30484 raft_consensus.cc:348] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.668061 30484 raft_consensus.cc:374] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.667999 30483 raft_consensus.cc:348] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.668115 30484 raft_consensus.cc:729] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.668155 30483 raft_consensus.cc:374] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.668224 30483 raft_consensus.cc:729] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.668310 30484 consensus_queue.cc:260] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.668403 30483 consensus_queue.cc:260] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.668601 30536 raft_consensus.cc:482] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.668699 30536 raft_consensus.cc:504] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.669241 30483 ts_tablet_manager.cc:1398] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.669476 30483 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.670087 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.670342 30365 raft_consensus.cc:2379] T 5bb63106daac4260b175d1e71f311d53 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:48.669250 30536 leader_election.cc:288] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.671087 30485 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.671147 30483 tablet_bootstrap.cc:654] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.671195 30485 ts_tablet_manager.cc:1367] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20240502 08:19:48.671591 30484 ts_tablet_manager.cc:1398] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:48.671854 30485 raft_consensus.cc:348] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.672070 30485 raft_consensus.cc:374] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.672130 30485 raft_consensus.cc:729] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.672376 30485 consensus_queue.cc:260] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.673094 30485 ts_tablet_manager.cc:1398] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.673426 30485 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.673439 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb63106daac4260b175d1e71f311d53" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.675185 30485 tablet_bootstrap.cc:654] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.675221 30406 leader_election.cc:302] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.675693 30536 raft_consensus.cc:3037] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.679023 30484 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.679014 30536 raft_consensus.cc:2726] T 5bb63106daac4260b175d1e71f311d53 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.680811 30484 tablet_bootstrap.cc:654] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.683076 30536 consensus_queue.cc:1035] T 03bb20d8df564ad582b1211921a3eeb9 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.684914 30488 raft_consensus.cc:482] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.685109 30488 raft_consensus.cc:504] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.685838 30488 leader_election.cc:288] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.686415 30483 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.686455 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.686570 30483 ts_tablet_manager.cc:1367] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.016s
I20240502 08:19:48.686560 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3fee88d46743d783de24a43f035574" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.686762 30293 raft_consensus.cc:2379] T 8d3fee88d46743d783de24a43f035574 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:48.687489 30406 leader_election.cc:302] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.687599 30483 raft_consensus.cc:348] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.687903 30483 raft_consensus.cc:374] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.687966 30483 raft_consensus.cc:729] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.688223 30488 raft_consensus.cc:3037] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.688242 30483 consensus_queue.cc:260] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.688925 30483 ts_tablet_manager.cc:1398] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:48.689285 30483 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.695092 30483 tablet_bootstrap.cc:654] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.692176 30488 raft_consensus.cc:2726] T 8d3fee88d46743d783de24a43f035574 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.705334 30483 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.705497 30483 ts_tablet_manager.cc:1367] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20240502 08:19:48.706281 30483 raft_consensus.cc:348] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.706526 30483 raft_consensus.cc:374] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.706652 30483 raft_consensus.cc:729] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.706871 30483 consensus_queue.cc:260] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.707500 30483 ts_tablet_manager.cc:1398] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.707778 30483 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.708094 30484 tablet_bootstrap.cc:492] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.708204 30484 ts_tablet_manager.cc:1367] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.006s
I20240502 08:19:48.708868 30484 raft_consensus.cc:348] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.709017 30484 raft_consensus.cc:374] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.709064 30484 raft_consensus.cc:729] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.709262 30484 consensus_queue.cc:260] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.709419 30483 tablet_bootstrap.cc:654] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.709908 30484 ts_tablet_manager.cc:1398] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.710167 30484 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.714043 30484 tablet_bootstrap.cc:654] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.716590 30485 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.716742 30485 ts_tablet_manager.cc:1367] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.043s user 0.023s sys 0.019s
I20240502 08:19:48.717475 30485 raft_consensus.cc:348] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.717710 30485 raft_consensus.cc:374] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.717777 30485 raft_consensus.cc:729] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.717986 30485 consensus_queue.cc:260] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.719553 30485 ts_tablet_manager.cc:1398] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:48.719843 30485 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.721243 30498 consensus_queue.cc:1035] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.721565 30485 tablet_bootstrap.cc:654] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.727741 30557 consensus_queue.cc:1035] T 3609240032904a1191b886666109ffd9 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.727895 30485 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.728013 30485 ts_tablet_manager.cc:1367] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20240502 08:19:48.728632 30485 raft_consensus.cc:348] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.728818 30485 raft_consensus.cc:374] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.728869 30485 raft_consensus.cc:729] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.729085 30485 consensus_queue.cc:260] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.729771 30485 ts_tablet_manager.cc:1398] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.730039 30485 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.731603 30485 tablet_bootstrap.cc:654] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.737548 30484 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.737668 30484 ts_tablet_manager.cc:1367] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
I20240502 08:19:48.738183 30483 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.738348 30483 ts_tablet_manager.cc:1367] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.013s
I20240502 08:19:48.738417 30484 raft_consensus.cc:348] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.738618 30484 raft_consensus.cc:374] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.738687 30484 raft_consensus.cc:729] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.739018 30484 consensus_queue.cc:260] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.739156 30483 raft_consensus.cc:348] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.739264 30485 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.739288 30483 raft_consensus.cc:374] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.739351 30483 raft_consensus.cc:729] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.739383 30485 ts_tablet_manager.cc:1367] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20240502 08:19:48.739552 30483 consensus_queue.cc:260] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.740034 30483 ts_tablet_manager.cc:1398] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:48.740111 30485 raft_consensus.cc:348] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.740281 30485 raft_consensus.cc:374] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.740351 30485 raft_consensus.cc:729] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.740490 30484 ts_tablet_manager.cc:1398] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:48.740504 30483 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.740582 30485 consensus_queue.cc:260] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.740756 30484 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.741236 30485 ts_tablet_manager.cc:1398] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.741513 30485 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.742298 30483 tablet_bootstrap.cc:654] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.743052 30485 tablet_bootstrap.cc:654] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.742298 30484 tablet_bootstrap.cc:654] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.748943 30483 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.749070 30483 ts_tablet_manager.cc:1367] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20240502 08:19:48.749794 30483 raft_consensus.cc:348] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.749992 30483 raft_consensus.cc:374] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.750046 30483 raft_consensus.cc:729] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.750233 30483 consensus_queue.cc:260] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.750797 30483 ts_tablet_manager.cc:1398] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.751030 30483 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.752511 30483 tablet_bootstrap.cc:654] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.754544 30485 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:48.754755 30485 ts_tablet_manager.cc:1367] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20240502 08:19:48.755702 30485 raft_consensus.cc:348] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.756043 30485 raft_consensus.cc:374] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.756225 30485 raft_consensus.cc:729] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.756726 30484 tablet_bootstrap.cc:492] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.756829 30484 ts_tablet_manager.cc:1367] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.008s
I20240502 08:19:48.756578 30485 consensus_queue.cc:260] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.757506 30485 ts_tablet_manager.cc:1398] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:48.757510 30484 raft_consensus.cc:348] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.757753 30484 raft_consensus.cc:374] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.757817 30484 raft_consensus.cc:729] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.758028 30484 consensus_queue.cc:260] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.758147 30485 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:48.758508 30484 ts_tablet_manager.cc:1398] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:48.758698 30484 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.759845 30484 tablet_bootstrap.cc:654] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.761607 30488 raft_consensus.cc:482] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.761762 30488 raft_consensus.cc:504] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.762140 30485 tablet_bootstrap.cc:654] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.762481 30488 leader_election.cc:288] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.763233 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5ccb0ec312c41d19235303c97f9e9cc" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.763422 30365 raft_consensus.cc:2454] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.763842 30408 leader_election.cc:302] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.765637 30488 raft_consensus.cc:2781] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.765724 30488 raft_consensus.cc:482] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.765798 30488 raft_consensus.cc:3037] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.768990 30483 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.769130 30483 ts_tablet_manager.cc:1367] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20240502 08:19:48.769239 30488 raft_consensus.cc:504] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.770087 30483 raft_consensus.cc:348] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.770306 30483 raft_consensus.cc:374] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.770390 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5ccb0ec312c41d19235303c97f9e9cc" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.770395 30483 raft_consensus.cc:729] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.770633 30293 raft_consensus.cc:3037] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.770929 30483 consensus_queue.cc:260] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.771808 30483 ts_tablet_manager.cc:1398] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 08:19:48.772151 30483 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.772934 30484 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.773054 30484 ts_tablet_manager.cc:1367] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20240502 08:19:48.774336 30483 tablet_bootstrap.cc:654] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.774420 30484 raft_consensus.cc:348] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.774590 30484 raft_consensus.cc:374] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.774681 30484 raft_consensus.cc:729] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.774878 30484 consensus_queue.cc:260] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.773663 30293 raft_consensus.cc:2454] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.777067 30406 leader_election.cc:302] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.777442 30536 raft_consensus.cc:2781] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.777566 30536 raft_consensus.cc:686] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.777828 30536 consensus_queue.cc:237] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.779361 30484 ts_tablet_manager.cc:1398] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 08:19:48.780139 30655 raft_consensus.cc:482] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.780285 30655 raft_consensus.cc:504] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.780941 30655 leader_election.cc:288] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.781438 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e2551cc79d4d17a61d49ae463e8764" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:48.781868 30258 leader_election.cc:341] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.782243 30484 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.782444 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e2551cc79d4d17a61d49ae463e8764" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.782618 30365 raft_consensus.cc:2454] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.782980 30259 leader_election.cc:302] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.783682 30655 raft_consensus.cc:2781] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.783767 30655 raft_consensus.cc:482] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.783843 30655 raft_consensus.cc:3037] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.784037 30484 tablet_bootstrap.cc:654] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.785147 30483 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.785387 30483 ts_tablet_manager.cc:1367] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.008s
I20240502 08:19:48.786283 30650 raft_consensus.cc:482] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.786473 30650 raft_consensus.cc:504] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.787268 30650 leader_election.cc:288] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.788026 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:48.788657 30258 leader_election.cc:341] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.788750 30189 catalog_manager.cc:5484] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:48.789386 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.789677 30365 raft_consensus.cc:2454] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:48.790128 30483 raft_consensus.cc:348] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.790210 30259 leader_election.cc:302] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.790236 30655 raft_consensus.cc:504] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.790385 30483 raft_consensus.cc:374] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.790496 30483 raft_consensus.cc:729] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.790731 30650 raft_consensus.cc:2781] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.790848 30650 raft_consensus.cc:482] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.790935 30650 raft_consensus.cc:3037] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.790750 30483 consensus_queue.cc:260] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.791639 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5ccb0ec312c41d19235303c97f9e9cc" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.791807 30369 raft_consensus.cc:3037] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.792040 30483 ts_tablet_manager.cc:1398] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 08:19:48.792493 30483 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.793107 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e2551cc79d4d17a61d49ae463e8764" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.793268 30365 raft_consensus.cc:3037] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.795197 30483 tablet_bootstrap.cc:654] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.795776 30557 consensus_queue.cc:1035] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.796020 30365 raft_consensus.cc:2454] T 76e2551cc79d4d17a61d49ae463e8764 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.789667 30484 tablet_bootstrap.cc:492] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.796780 30484 ts_tablet_manager.cc:1367] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20240502 08:19:48.797559 30484 raft_consensus.cc:348] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.797777 30484 raft_consensus.cc:374] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.797844 30484 raft_consensus.cc:729] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.798059 30484 consensus_queue.cc:260] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.798731 30484 ts_tablet_manager.cc:1398] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:48.799005 30484 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.800338 30259 leader_election.cc:302] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.800613 30490 raft_consensus.cc:2781] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.800783 30490 raft_consensus.cc:686] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.801106 30490 consensus_queue.cc:237] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.803560 30484 tablet_bootstrap.cc:654] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.804113 30536 raft_consensus.cc:482] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.804319 30536 raft_consensus.cc:504] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.804559 30483 tablet_bootstrap.cc:492] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.804823 30483 ts_tablet_manager.cc:1367] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20240502 08:19:48.805079 30536 leader_election.cc:288] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.805415 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.805646 30292 raft_consensus.cc:2454] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.806026 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.806288 30365 raft_consensus.cc:2454] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.806557 30406 leader_election.cc:302] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.806861 30536 raft_consensus.cc:2781] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.806977 30536 raft_consensus.cc:482] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.807096 30536 raft_consensus.cc:3037] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.806286 30483 raft_consensus.cc:348] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.807662 30483 raft_consensus.cc:374] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.807868 30483 raft_consensus.cc:729] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.808214 30483 consensus_queue.cc:260] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.809042 30483 ts_tablet_manager.cc:1398] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:48.809470 30483 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.809392 30650 raft_consensus.cc:504] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.809685 30536 raft_consensus.cc:504] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.810511 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.810940 30365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
W20240502 08:19:48.811136 30258 leader_election.cc:341] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.811136 30365 raft_consensus.cc:3037] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.812296 30483 tablet_bootstrap.cc:654] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.813392 30536 leader_election.cc:288] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.813547 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.810571 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1bcd6afa6b4ac5a7afff0f8259bf38" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.826169 30488 leader_election.cc:288] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.838290 30655 leader_election.cc:288] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.777858 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5ccb0ec312c41d19235303c97f9e9cc" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.839573 30292 raft_consensus.cc:3037] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.842581 30557 raft_consensus.cc:482] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.842798 30557 raft_consensus.cc:504] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.843762 30557 leader_election.cc:288] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.845050 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357103558ce04e16867cd583542709d3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.845981 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357103558ce04e16867cd583542709d3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.846596 30367 raft_consensus.cc:3037] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.846951 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e2551cc79d4d17a61d49ae463e8764" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.847389 30650 leader_election.cc:288] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.852730 30367 raft_consensus.cc:2454] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.853664 30554 consensus_queue.cc:1035] T af3cd710facb49a19984c4a447033a41 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20240502 08:19:48.855849 30369 raft_consensus.cc:2454] T b5ccb0ec312c41d19235303c97f9e9cc P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.856148 30365 raft_consensus.cc:2454] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.857205 30292 raft_consensus.cc:2454] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.857964 30259 leader_election.cc:302] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:48.859812 30291 raft_consensus.cc:2362] T b5ccb0ec312c41d19235303c97f9e9cc P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1. Re-sending same reply.
I20240502 08:19:48.860075 30439 raft_consensus.cc:2454] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.860191 30484 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.860302 30441 raft_consensus.cc:3037] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.860358 30484 ts_tablet_manager.cc:1367] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.061s user 0.016s sys 0.030s
I20240502 08:19:48.860783 30483 tablet_bootstrap.cc:492] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.861095 30483 ts_tablet_manager.cc:1367] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.052s user 0.010s sys 0.014s
I20240502 08:19:48.861261 30484 raft_consensus.cc:348] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.861513 30484 raft_consensus.cc:374] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.861604 30484 raft_consensus.cc:729] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.861864 30484 consensus_queue.cc:260] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.862530 30484 ts_tablet_manager.cc:1398] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 08:19:48.862962 30483 raft_consensus.cc:348] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.863373 30441 raft_consensus.cc:2454] T 76e2551cc79d4d17a61d49ae463e8764 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:48.863521 30483 raft_consensus.cc:374] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.863713 30483 raft_consensus.cc:729] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.863903 30484 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.863723 30408 leader_election.cc:302] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.864213 30483 consensus_queue.cc:260] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.864492 30536 raft_consensus.cc:2781] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.864835 30536 raft_consensus.cc:686] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.865216 30536 consensus_queue.cc:237] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.865667 30484 tablet_bootstrap.cc:654] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.867882 30333 leader_election.cc:302] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.868315 30558 raft_consensus.cc:482] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.868440 30558 raft_consensus.cc:504] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.869076 30558 leader_election.cc:288] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.869271 30558 raft_consensus.cc:2781] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.869413 30558 raft_consensus.cc:482] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.869544 30558 raft_consensus.cc:3037] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.869836 30483 ts_tablet_manager.cc:1398] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240502 08:19:48.870318 30483 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.872751 30483 tablet_bootstrap.cc:654] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.873448 30558 raft_consensus.cc:504] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.874228 30558 leader_election.cc:288] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.874836 30484 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.875000 30484 ts_tablet_manager.cc:1367] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20240502 08:19:48.875495 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.875555 30290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357103558ce04e16867cd583542709d3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.876000 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ffe2cc9dc1e4f0fafe4371c3b908e9f" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.876101 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357103558ce04e16867cd583542709d3" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.876286 30439 raft_consensus.cc:2379] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:48.876286 30440 raft_consensus.cc:3037] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.877717 30607 raft_consensus.cc:482] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.877952 30607 raft_consensus.cc:504] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.878796 30293 raft_consensus.cc:2454] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.878888 30607 leader_election.cc:288] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.879310 30488 consensus_queue.cc:1035] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20240502 08:19:48.879498 30440 raft_consensus.cc:2454] T 357103558ce04e16867cd583542709d3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.880930 30655 raft_consensus.cc:2781] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.881119 30655 raft_consensus.cc:686] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:48.881608 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309951d8b8b646988666292e5f6108e4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:48.882149 30406 leader_election.cc:341] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.882418 30488 consensus_queue.cc:1035] T a5b04d480698434e9842efbe6fdf0038 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.881459 30655 consensus_queue.cc:237] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.884418 30554 raft_consensus.cc:482] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.884575 30333 leader_election.cc:302] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339
I20240502 08:19:48.884631 30554 raft_consensus.cc:504] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.885126 30333 leader_election.cc:302] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.885231 30554 leader_election.cc:288] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.885658 30557 raft_consensus.cc:3037] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.885753 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309951d8b8b646988666292e5f6108e4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:48.885924 30498 raft_consensus.cc:2781] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.885970 30369 raft_consensus.cc:2454] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:48.886103 30498 raft_consensus.cc:686] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.886385 30483 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.886487 30408 leader_election.cc:302] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.886459 30498 consensus_queue.cc:237] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.886708 30483 ts_tablet_manager.cc:1367] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.011s
I20240502 08:19:48.887924 30536 raft_consensus.cc:2781] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.888021 30536 raft_consensus.cc:482] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.888113 30536 raft_consensus.cc:3037] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.888671 30557 raft_consensus.cc:2726] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.887676 30483 raft_consensus.cc:348] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.889087 30483 raft_consensus.cc:374] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.889302 30483 raft_consensus.cc:729] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.889587 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228dc2bad04d4a719b5ef3a991de2873" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.889816 30440 raft_consensus.cc:2454] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.889679 30483 consensus_queue.cc:260] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.890221 30333 leader_election.cc:302] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.890499 30557 raft_consensus.cc:2781] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.890623 30557 raft_consensus.cc:482] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.890739 30557 raft_consensus.cc:3037] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.891144 30483 ts_tablet_manager.cc:1398] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 08:19:48.891604 30483 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.893797 30557 raft_consensus.cc:504] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.894127 30536 raft_consensus.cc:504] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.895120 30536 leader_election.cc:288] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.894019 30483 tablet_bootstrap.cc:654] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.895368 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309951d8b8b646988666292e5f6108e4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.895587 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309951d8b8b646988666292e5f6108e4" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:48.895805 30369 raft_consensus.cc:3037] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
W20240502 08:19:48.895941 30406 leader_election.cc:341] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.896203 30484 raft_consensus.cc:348] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.896448 30484 raft_consensus.cc:374] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.896549 30484 raft_consensus.cc:729] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.896818 30484 consensus_queue.cc:260] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.897447 30484 ts_tablet_manager.cc:1398] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20240502 08:19:48.897807 30484 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.898344 30536 consensus_queue.cc:1035] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.899669 30484 tablet_bootstrap.cc:654] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.901888 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228dc2bad04d4a719b5ef3a991de2873" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:48.902089 30292 raft_consensus.cc:3037] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.902340 30369 raft_consensus.cc:2454] T 309951d8b8b646988666292e5f6108e4 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:48.902808 30408 leader_election.cc:302] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.902287 30189 catalog_manager.cc:5484] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:48.903316 30536 raft_consensus.cc:2781] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.903463 30536 raft_consensus.cc:686] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:48.903760 30536 consensus_queue.cc:237] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.905071 30292 raft_consensus.cc:2454] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.905602 30332 leader_election.cc:302] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:48.906157 30555 raft_consensus.cc:2781] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.906332 30555 raft_consensus.cc:686] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.907928 30557 leader_election.cc:288] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.910607 30483 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:48.910898 30483 ts_tablet_manager.cc:1367] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.010s
I20240502 08:19:48.912065 30483 raft_consensus.cc:348] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.912341 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228dc2bad04d4a719b5ef3a991de2873" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.912421 30650 consensus_queue.cc:1035] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.912518 30438 raft_consensus.cc:3037] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.912441 30483 raft_consensus.cc:374] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.912711 30483 raft_consensus.cc:729] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.913029 30483 consensus_queue.cc:260] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.914269 30483 ts_tablet_manager.cc:1398] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:48.914240 30650 consensus_queue.cc:1035] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.915275 30438 raft_consensus.cc:2454] T 228dc2bad04d4a719b5ef3a991de2873 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.915824 30554 consensus_queue.cc:1035] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.917222 30483 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:48.919678 30483 tablet_bootstrap.cc:654] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:48.922744 30545 consensus_queue.cc:1035] T 9ffe2cc9dc1e4f0fafe4371c3b908e9f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.924345 30554 raft_consensus.cc:482] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.924503 30554 raft_consensus.cc:504] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.925391 30554 leader_election.cc:288] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.925892 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:48.926432 30332 leader_election.cc:341] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.927350 30440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:48.927557 30440 raft_consensus.cc:2454] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:48.928058 30333 leader_election.cc:302] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.928545 30554 raft_consensus.cc:2781] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:48.928520 30607 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.928618 30554 raft_consensus.cc:482] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:48.929523 30554 raft_consensus.cc:3037] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.933502 30366 raft_consensus.cc:3037] T 93a5263941344036a18c7993a0bf88f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.938584 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228dc2bad04d4a719b5ef3a991de2873" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:48.938819 30291 raft_consensus.cc:2362] T 228dc2bad04d4a719b5ef3a991de2873 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1. Re-sending same reply.
I20240502 08:19:48.939769 30651 consensus_queue.cc:1035] T 93a5263941344036a18c7993a0bf88f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.944669 30554 raft_consensus.cc:504] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.945298 30554 leader_election.cc:288] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:48.946566 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:48.946974 30438 raft_consensus.cc:3037] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:48.951380 30557 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.954623 30488 raft_consensus.cc:482] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:48.955139 30488 raft_consensus.cc:504] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.956089 30488 leader_election.cc:288] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:48.956467 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
W20240502 08:19:48.957024 30408 leader_election.cc:341] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.957302 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:48.957926 30406 leader_election.cc:341] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:48.958055 30406 leader_election.cc:302] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:48.958472 30488 raft_consensus.cc:2726] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:48.959354 30750 consensus_queue.cc:1035] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.961928 30650 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.975654 30484 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:48.975821 30484 ts_tablet_manager.cc:1367] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.000s
I20240502 08:19:48.976519 30484 raft_consensus.cc:348] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.976722 30484 raft_consensus.cc:374] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:48.976776 30484 raft_consensus.cc:729] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:48.976949 30484 consensus_queue.cc:260] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.977571 30484 ts_tablet_manager.cc:1398] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:48.977876 30484 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:48.979820 30650 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.985543 30438 raft_consensus.cc:2454] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:48.986022 30333 leader_election.cc:302] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:48.986403 30554 raft_consensus.cc:2781] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:48.986564 30554 raft_consensus.cc:686] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:48.986887 30554 consensus_queue.cc:237] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:48.992818 30607 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.993268 30576 consensus_queue.cc:1035] T a811b43b5d634c76b4c138b5e36878b4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:48.997674 30484 tablet_bootstrap.cc:654] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
W20240502 08:19:49.013787 30332 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.130.129:35355, user_credentials={real_user=slave}} blocked reactor thread for 79173.7us
I20240502 08:19:49.014480 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
W20240502 08:19:49.016654 30332 leader_election.cc:341] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.019284 30557 raft_consensus.cc:482] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.019471 30557 raft_consensus.cc:504] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.019693 30192 catalog_manager.cc:5484] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.020277 30557 leader_election.cc:288] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.021899 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e636180fea54536809d2981178098d8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.022100 30442 raft_consensus.cc:2454] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.022186 30750 consensus_queue.cc:1035] T 951a8b753a7940cdb6e831be5bb8c3e1 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.022732 30558 consensus_queue.cc:1035] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.023272 30333 leader_election.cc:302] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.023532 30750 raft_consensus.cc:2781] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.023607 30750 raft_consensus.cc:482] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.023674 30750 raft_consensus.cc:3037] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.025424 30558 consensus_queue.cc:1035] T 8d3fee88d46743d783de24a43f035574 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.028275 30498 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.031006 30289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e636180fea54536809d2981178098d8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.031236 30289 raft_consensus.cc:2454] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.038393 30750 raft_consensus.cc:504] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.039669 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e636180fea54536809d2981178098d8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.039764 30750 leader_election.cc:288] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.039860 30438 raft_consensus.cc:3037] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.042774 30438 raft_consensus.cc:2454] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.043108 30333 leader_election.cc:302] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.044306 30750 raft_consensus.cc:2781] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.044437 30750 raft_consensus.cc:686] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.044688 30750 consensus_queue.cc:237] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.051010 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e636180fea54536809d2981178098d8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.051244 30291 raft_consensus.cc:3037] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.051620 30192 catalog_manager.cc:5484] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.052189 30192 catalog_manager.cc:5484] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.053037 30555 consensus_queue.cc:237] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.053803 30291 raft_consensus.cc:2454] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.057768 30484 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.057930 30484 ts_tablet_manager.cc:1367] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.080s user 0.017s sys 0.004s
I20240502 08:19:49.059938 30484 raft_consensus.cc:348] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.060117 30484 raft_consensus.cc:374] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.060181 30484 raft_consensus.cc:729] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.060355 30484 consensus_queue.cc:260] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.060853 30484 ts_tablet_manager.cc:1398] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:49.061157 30484 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.062812 30576 consensus_queue.cc:1035] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.065485 30554 consensus_queue.cc:1035] T 1c18a897201c4587a6900e05c5dd5b2f P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.072551 30484 tablet_bootstrap.cc:654] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.080322 30488 raft_consensus.cc:482] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.080477 30488 raft_consensus.cc:504] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.080416 30192 catalog_manager.cc:5484] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.081121 30488 leader_election.cc:288] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.081229 30607 consensus_queue.cc:1035] T 76bd11b5cffd4dcd9b40fea93fa400ad P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.081605 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1acd903a90d04ba3b1496480bcbcc9d7" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.081785 30366 raft_consensus.cc:2454] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.082062 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1acd903a90d04ba3b1496480bcbcc9d7" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.082118 30408 leader_election.cc:302] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.082381 30607 raft_consensus.cc:2781] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.082455 30607 raft_consensus.cc:482] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240502 08:19:49.082482 30406 leader_election.cc:341] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.082522 30607 raft_consensus.cc:3037] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.083783 30484 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.083915 30484 ts_tablet_manager.cc:1367] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20240502 08:19:49.084587 30484 raft_consensus.cc:348] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.084780 30484 raft_consensus.cc:374] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.084826 30484 raft_consensus.cc:729] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.085021 30484 consensus_queue.cc:260] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.085135 30607 raft_consensus.cc:504] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.085533 30484 ts_tablet_manager.cc:1398] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.085812 30484 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.085877 30607 leader_election.cc:288] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.086251 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1acd903a90d04ba3b1496480bcbcc9d7" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.086432 30367 raft_consensus.cc:3037] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.086485 30485 tablet_bootstrap.cc:492] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.086607 30485 ts_tablet_manager.cc:1367] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.329s user 0.079s sys 0.101s
I20240502 08:19:49.087273 30485 raft_consensus.cc:348] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.087463 30485 raft_consensus.cc:374] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.087421 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1acd903a90d04ba3b1496480bcbcc9d7" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.087514 30485 raft_consensus.cc:729] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.087698 30485 consensus_queue.cc:260] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.087924 30292 raft_consensus.cc:3037] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.088181 30485 ts_tablet_manager.cc:1398] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 08:19:49.088460 30485 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.089257 30367 raft_consensus.cc:2454] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.089695 30408 leader_election.cc:302] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.089963 30607 raft_consensus.cc:2781] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.090080 30607 raft_consensus.cc:686] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:49.090170 30485 tablet_bootstrap.cc:654] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.090333 30607 consensus_queue.cc:237] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.093169 30490 consensus_queue.cc:1035] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.093415 30484 tablet_bootstrap.cc:654] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.094077 30292 raft_consensus.cc:2454] T 1acd903a90d04ba3b1496480bcbcc9d7 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.097788 30490 consensus_queue.cc:1035] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.110142 30488 raft_consensus.cc:482] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.110400 30488 raft_consensus.cc:504] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.111502 30488 leader_election.cc:288] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.112288 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.112646 30367 raft_consensus.cc:2379] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:49.112586 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd976cd2d74411997117f936069dd1b" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.113430 30406 leader_election.cc:302] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.114147 30488 raft_consensus.cc:3037] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.118157 30488 raft_consensus.cc:2726] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:49.128350 30189 catalog_manager.cc:5484] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.129106 30189 catalog_manager.cc:5484] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.133846 30490 consensus_queue.cc:1035] T 6e3c3b43f2cb49d1b17c900a85280c29 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.139225 30490 consensus_queue.cc:1035] T 5bb63106daac4260b175d1e71f311d53 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.148535 30189 catalog_manager.cc:5484] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.154011 30485 tablet_bootstrap.cc:492] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.154147 30485 ts_tablet_manager.cc:1367] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.000s
I20240502 08:19:49.154397 30483 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.154517 30483 ts_tablet_manager.cc:1367] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.237s user 0.094s sys 0.081s
I20240502 08:19:49.154822 30485 raft_consensus.cc:348] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.154994 30485 raft_consensus.cc:374] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.155048 30485 raft_consensus.cc:729] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.155124 30483 raft_consensus.cc:348] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.155293 30483 raft_consensus.cc:374] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.155352 30483 raft_consensus.cc:729] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.155263 30485 consensus_queue.cc:260] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.155571 30483 consensus_queue.cc:260] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.156183 30483 ts_tablet_manager.cc:1398] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:49.156462 30483 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.156893 30485 ts_tablet_manager.cc:1398] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.157147 30485 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.158078 30483 tablet_bootstrap.cc:654] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.158160 30191 catalog_manager.cc:5484] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.158768 30485 tablet_bootstrap.cc:654] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.180033 30484 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.180400 30484 ts_tablet_manager.cc:1367] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.095s user 0.033s sys 0.041s
I20240502 08:19:49.181519 30484 raft_consensus.cc:348] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.181933 30484 raft_consensus.cc:374] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.182058 30484 raft_consensus.cc:729] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.182463 30490 raft_consensus.cc:482] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.182632 30490 raft_consensus.cc:504] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.182471 30484 consensus_queue.cc:260] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.183324 30490 leader_election.cc:288] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.183658 30484 ts_tablet_manager.cc:1398] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.183952 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57d2d37396543d6bbfb2e16edc75b7d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.184160 30484 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.184696 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57d2d37396543d6bbfb2e16edc75b7d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:49.185196 30258 leader_election.cc:341] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.184172 30367 raft_consensus.cc:2454] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.185797 30259 leader_election.cc:302] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:49.186098 30490 raft_consensus.cc:2781] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.186188 30490 raft_consensus.cc:482] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.186283 30490 raft_consensus.cc:3037] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.186681 30484 tablet_bootstrap.cc:654] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.187350 30485 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.187398 30483 tablet_bootstrap.cc:492] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.187523 30483 ts_tablet_manager.cc:1367] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.011s
I20240502 08:19:49.187526 30485 ts_tablet_manager.cc:1367] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.015s
I20240502 08:19:49.188247 30485 raft_consensus.cc:348] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.188454 30485 raft_consensus.cc:374] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.188562 30485 raft_consensus.cc:729] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.188446 30483 raft_consensus.cc:348] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.188717 30483 raft_consensus.cc:374] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.188792 30483 raft_consensus.cc:729] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.188773 30485 consensus_queue.cc:260] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.189054 30483 consensus_queue.cc:260] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.189373 30485 ts_tablet_manager.cc:1398] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.189635 30485 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.189929 30483 ts_tablet_manager.cc:1398] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.190258 30483 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.191380 30485 tablet_bootstrap.cc:654] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.192755 30483 tablet_bootstrap.cc:654] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.189121 30490 raft_consensus.cc:504] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.194759 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57d2d37396543d6bbfb2e16edc75b7d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.195008 30367 raft_consensus.cc:3037] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.195261 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57d2d37396543d6bbfb2e16edc75b7d" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.195422 30442 raft_consensus.cc:3037] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.195614 30490 leader_election.cc:288] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.200099 30442 raft_consensus.cc:2454] T e57d2d37396543d6bbfb2e16edc75b7d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.200551 30367 raft_consensus.cc:2454] T e57d2d37396543d6bbfb2e16edc75b7d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.201743 30259 leader_election.cc:302] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.202087 30484 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.202224 30484 ts_tablet_manager.cc:1367] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.009s
I20240502 08:19:49.202988 30484 raft_consensus.cc:348] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.203209 30484 raft_consensus.cc:374] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.203276 30484 raft_consensus.cc:729] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.203507 30484 consensus_queue.cc:260] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.203671 30556 raft_consensus.cc:2781] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.203847 30556 raft_consensus.cc:686] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:49.204041 30484 ts_tablet_manager.cc:1398] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:49.204164 30556 consensus_queue.cc:237] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.206108 30484 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.212504 30483 tablet_bootstrap.cc:492] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.212666 30484 tablet_bootstrap.cc:654] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.212689 30485 tablet_bootstrap.cc:492] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.212859 30483 ts_tablet_manager.cc:1367] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20240502 08:19:49.212865 30485 ts_tablet_manager.cc:1367] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.011s
I20240502 08:19:49.213743 30483 raft_consensus.cc:348] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.214116 30483 raft_consensus.cc:374] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.214191 30483 raft_consensus.cc:729] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.214540 30483 consensus_queue.cc:260] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.213853 30485 raft_consensus.cc:348] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.215050 30485 raft_consensus.cc:374] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.215122 30485 raft_consensus.cc:729] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.215227 30483 ts_tablet_manager.cc:1398] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.215345 30485 consensus_queue.cc:260] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.215636 30483 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.215945 30485 ts_tablet_manager.cc:1398] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:49.216487 30485 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.217494 30483 tablet_bootstrap.cc:654] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.218062 30485 tablet_bootstrap.cc:654] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.220286 30191 catalog_manager.cc:5484] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.223843 30484 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.224071 30484 ts_tablet_manager.cc:1367] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.004s
I20240502 08:19:49.225190 30484 raft_consensus.cc:348] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.225556 30484 raft_consensus.cc:374] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.225697 30484 raft_consensus.cc:729] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.226078 30484 consensus_queue.cc:260] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.226891 30484 ts_tablet_manager.cc:1398] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.227383 30484 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.229539 30484 tablet_bootstrap.cc:654] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.233907 30483 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.234071 30483 ts_tablet_manager.cc:1367] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.013s
I20240502 08:19:49.235160 30483 raft_consensus.cc:348] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.235448 30483 raft_consensus.cc:374] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.235502 30483 raft_consensus.cc:729] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.237495 30483 consensus_queue.cc:260] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.239499 30485 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.239651 30485 ts_tablet_manager.cc:1367] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.011s
I20240502 08:19:49.240101 30483 ts_tablet_manager.cc:1398] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 08:19:49.240303 30485 raft_consensus.cc:348] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.240434 30483 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.240489 30485 raft_consensus.cc:374] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.240916 30485 raft_consensus.cc:729] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.241178 30485 consensus_queue.cc:260] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.243028 30483 tablet_bootstrap.cc:654] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.244601 30485 ts_tablet_manager.cc:1398] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 08:19:49.244876 30485 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.244901 30484 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.245012 30484 ts_tablet_manager.cc:1367] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.009s
I20240502 08:19:49.245538 30484 raft_consensus.cc:348] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.245743 30484 raft_consensus.cc:374] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.245815 30484 raft_consensus.cc:729] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.246004 30484 consensus_queue.cc:260] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.246568 30484 ts_tablet_manager.cc:1398] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 08:19:49.246852 30484 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.248144 30484 tablet_bootstrap.cc:654] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.249361 30483 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.249485 30483 ts_tablet_manager.cc:1367] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240502 08:19:49.250134 30483 raft_consensus.cc:348] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.250303 30484 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.250344 30483 raft_consensus.cc:374] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.250442 30483 raft_consensus.cc:729] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.250447 30484 ts_tablet_manager.cc:1367] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 08:19:49.250674 30483 consensus_queue.cc:260] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.251204 30483 ts_tablet_manager.cc:1398] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:49.251076 30484 raft_consensus.cc:348] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.251332 30484 raft_consensus.cc:374] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.251390 30484 raft_consensus.cc:729] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.251572 30483 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.251596 30484 consensus_queue.cc:260] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.252123 30484 ts_tablet_manager.cc:1398] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:49.253010 30483 tablet_bootstrap.cc:654] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.253233 30484 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.253888 30607 raft_consensus.cc:482] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.254019 30607 raft_consensus.cc:504] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.254675 30607 leader_election.cc:288] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.254807 30484 tablet_bootstrap.cc:654] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.255422 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.255546 30556 raft_consensus.cc:482] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.255648 30556 raft_consensus.cc:504] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.256166 30556 leader_election.cc:288] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
W20240502 08:19:49.256292 30408 leader_election.cc:341] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.256662 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.259030 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.259276 30442 raft_consensus.cc:2379] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:49.259826 30555 raft_consensus.cc:482] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.259994 30555 raft_consensus.cc:504] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.260639 30555 leader_election.cc:288] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.261217 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
W20240502 08:19:49.261345 30240 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20240502 08:19:49.261796 30332 leader_election.cc:341] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.261788 30485 tablet_bootstrap.cc:654] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.261972 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462907f615aa4a789ccac135ab693fdd" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.262585 30259 leader_election.cc:302] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:49.262996 30556 raft_consensus.cc:3037] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.266059 30556 raft_consensus.cc:2726] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 08:19:49.267307 30406 leader_election.cc:341] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.267427 30406 leader_election.cc:302] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.268182 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.268352 30442 raft_consensus.cc:2454] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.268590 30607 raft_consensus.cc:2726] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:49.269897 30333 leader_election.cc:302] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.270301 30555 raft_consensus.cc:2781] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.270383 30555 raft_consensus.cc:482] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.270437 30555 raft_consensus.cc:3037] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.270502 30485 tablet_bootstrap.cc:492] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.270637 30485 ts_tablet_manager.cc:1367] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.008s
I20240502 08:19:49.271550 30485 raft_consensus.cc:348] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.271818 30485 raft_consensus.cc:374] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.271883 30485 raft_consensus.cc:729] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.272157 30485 consensus_queue.cc:260] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.272797 30555 raft_consensus.cc:504] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.273581 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
W20240502 08:19:49.273969 30332 leader_election.cc:341] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.276829 30490 consensus_queue.cc:1035] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.279618 30749 raft_consensus.cc:482] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.279812 30749 raft_consensus.cc:504] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.280683 30749 leader_election.cc:288] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.281143 30490 raft_consensus.cc:482] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.281375 30490 raft_consensus.cc:504] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.282155 30490 leader_election.cc:288] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.282980 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.283288 30292 raft_consensus.cc:2454] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.282999 30555 leader_election.cc:288] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.283914 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.284124 30442 raft_consensus.cc:2454] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.284132 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.284493 30368 raft_consensus.cc:2454] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.284914 30484 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.284898 30259 leader_election.cc:302] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.285133 30484 ts_tablet_manager.cc:1367] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.001s
I20240502 08:19:49.285198 30332 leader_election.cc:302] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.285715 30555 raft_consensus.cc:2781] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.285856 30556 raft_consensus.cc:2781] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.285907 30555 raft_consensus.cc:482] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.286007 30556 raft_consensus.cc:482] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.286183 30556 raft_consensus.cc:3037] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.286202 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.286394 30555 raft_consensus.cc:3037] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.286477 30439 raft_consensus.cc:3037] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.287417 30485 ts_tablet_manager.cc:1398] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20240502 08:19:49.288565 30485 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.290431 30483 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.294857 30556 raft_consensus.cc:504] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.295465 30607 consensus_queue.cc:1035] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.286001 30484 raft_consensus.cc:348] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.297463 30555 raft_consensus.cc:504] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.298457 30439 raft_consensus.cc:2454] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.298668 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.298923 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.302281 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.302625 30368 raft_consensus.cc:2379] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:49.303200 30556 leader_election.cc:288] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.304817 30442 raft_consensus.cc:2454] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.305146 30485 tablet_bootstrap.cc:654] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.307389 30484 raft_consensus.cc:374] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.307495 30484 raft_consensus.cc:729] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.307525 30485 tablet_bootstrap.cc:492] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.307432 30607 consensus_queue.cc:1035] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20240502 08:19:49.307680 30485 ts_tablet_manager.cc:1367] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20240502 08:19:49.307758 30484 consensus_queue.cc:260] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.307931 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.308106 30438 raft_consensus.cc:3037] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.308331 30484 ts_tablet_manager.cc:1398] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20240502 08:19:49.308420 30485 raft_consensus.cc:348] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.308635 30485 raft_consensus.cc:374] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.308673 30484 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.308712 30485 raft_consensus.cc:729] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.308965 30485 consensus_queue.cc:260] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.309448 30485 ts_tablet_manager.cc:1398] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.309733 30485 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.310305 30484 tablet_bootstrap.cc:654] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.314091 30438 raft_consensus.cc:2454] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.307236 30483 ts_tablet_manager.cc:1367] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.022s
I20240502 08:19:49.311306 30485 tablet_bootstrap.cc:654] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.314690 30258 leader_election.cc:302] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:49.315146 30293 raft_consensus.cc:2379] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:49.315187 30333 leader_election.cc:302] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.315687 30556 raft_consensus.cc:2781] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.315852 30556 raft_consensus.cc:686] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:49.316205 30488 raft_consensus.cc:482] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.316170 30556 consensus_queue.cc:237] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.316361 30488 raft_consensus.cc:504] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.316992 30488 leader_election.cc:288] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.317477 30750 raft_consensus.cc:2781] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.317600 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.317754 30554 raft_consensus.cc:482] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.317644 30750 raft_consensus.cc:686] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.317819 30483 raft_consensus.cc:348] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.318312 30483 raft_consensus.cc:374] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.318547 30483 raft_consensus.cc:729] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.318660 30750 consensus_queue.cc:237] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.319068 30483 consensus_queue.cc:260] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.318055 30554 raft_consensus.cc:504] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.319609 30483 ts_tablet_manager.cc:1398] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:19:49.319762 30554 leader_election.cc:288] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
W20240502 08:19:49.320613 30408 leader_election.cc:341] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.320981 30293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.321218 30293 raft_consensus.cc:2454] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.321499 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e47d748c7f24cba9f9e1ec2e91b8136" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.321590 30554 raft_consensus.cc:482] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.321725 30554 raft_consensus.cc:504] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.322597 30554 leader_election.cc:288] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.321722 30291 raft_consensus.cc:2454] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.323318 30332 leader_election.cc:302] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.323912 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.324618 30749 raft_consensus.cc:2781] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.324769 30749 raft_consensus.cc:482] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.324875 30749 raft_consensus.cc:3037] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.326881 30483 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.328130 30749 raft_consensus.cc:504] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.328989 30749 leader_election.cc:288] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.329201 30483 tablet_bootstrap.cc:654] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
W20240502 08:19:49.330475 30332 leader_election.cc:341] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.330952 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e47d748c7f24cba9f9e1ec2e91b8136" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.331180 30291 raft_consensus.cc:3037] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.335453 30483 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.335717 30483 ts_tablet_manager.cc:1367] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.003s
I20240502 08:19:49.336066 30191 catalog_manager.cc:5484] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.336915 30483 raft_consensus.cc:348] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.337244 30483 raft_consensus.cc:374] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.337402 30483 raft_consensus.cc:729] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.337687 30483 consensus_queue.cc:260] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.338405 30483 ts_tablet_manager.cc:1398] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.338754 30483 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.339112 30488 consensus_queue.cc:1035] T b5ccb0ec312c41d19235303c97f9e9cc P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.340837 30483 tablet_bootstrap.cc:654] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.342018 30484 tablet_bootstrap.cc:492] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.342218 30484 ts_tablet_manager.cc:1367] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20240502 08:19:49.342566 30406 leader_election.cc:302] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc
I20240502 08:19:49.343562 30576 raft_consensus.cc:2781] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.346395 30607 consensus_queue.cc:1035] T 9d1bcd6afa6b4ac5a7afff0f8259bf38 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.347159 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e47d748c7f24cba9f9e1ec2e91b8136" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.347424 30555 leader_election.cc:288] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.316066 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b9f87872b36437fa743b50dd0c53ce8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.349153 30439 raft_consensus.cc:2379] T 6b9f87872b36437fa743b50dd0c53ce8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in this term.
I20240502 08:19:49.349805 30333 leader_election.cc:302] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339
I20240502 08:19:49.350296 30555 raft_consensus.cc:2726] T 6b9f87872b36437fa743b50dd0c53ce8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 08:19:49.334340 30291 raft_consensus.cc:2454] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.351238 30332 leader_election.cc:302] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.384903 30484 raft_consensus.cc:348] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.385263 30484 raft_consensus.cc:374] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.385414 30484 raft_consensus.cc:729] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.385542 30576 raft_consensus.cc:482] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.385757 30576 raft_consensus.cc:3037] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.386191 30484 consensus_queue.cc:260] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.387144 30484 ts_tablet_manager.cc:1398] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20240502 08:19:49.387519 30484 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.388429 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e47d748c7f24cba9f9e1ec2e91b8136" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.388934 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.389179 30442 raft_consensus.cc:2454] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.389451 30438 raft_consensus.cc:2454] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.389705 30555 raft_consensus.cc:2781] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.389775 30484 tablet_bootstrap.cc:654] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.389885 30555 raft_consensus.cc:686] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.390272 30555 consensus_queue.cc:237] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.390877 30490 consensus_queue.cc:1035] T 76e2551cc79d4d17a61d49ae463e8764 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20240502 08:19:49.392710 30483 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.393935 30483 ts_tablet_manager.cc:1367] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.055s user 0.014s sys 0.038s
I20240502 08:19:49.394796 30483 raft_consensus.cc:348] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.395118 30483 raft_consensus.cc:374] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.395188 30749 raft_consensus.cc:482] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.395331 30483 raft_consensus.cc:729] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.395334 30749 raft_consensus.cc:504] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.395678 30483 consensus_queue.cc:260] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.395992 30749 leader_election.cc:288] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.396449 30483 ts_tablet_manager.cc:1398] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:49.396826 30483 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.397275 30292 raft_consensus.cc:3037] T 357103558ce04e16867cd583542709d3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.400125 30485 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.400519 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.400671 30291 raft_consensus.cc:2454] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.403156 30332 leader_election.cc:302] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.403534 30750 raft_consensus.cc:482] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.403662 30750 raft_consensus.cc:504] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.404211 30750 leader_election.cc:288] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.404340 30750 consensus_queue.cc:1035] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.404665 30750 raft_consensus.cc:2781] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.404747 30750 raft_consensus.cc:482] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.404819 30750 raft_consensus.cc:3037] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.406541 30748 consensus_queue.cc:1035] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.406433 30191 catalog_manager.cc:5484] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.408248 30290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82577cbf65394ea1b821117762f25b58" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.411365 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
W20240502 08:19:49.413874 30332 leader_election.cc:341] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.414500 30483 tablet_bootstrap.cc:654] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.415220 30750 raft_consensus.cc:504] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.416115 30485 ts_tablet_manager.cc:1367] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.106s user 0.016s sys 0.008s
I20240502 08:19:49.416914 30485 raft_consensus.cc:348] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.417241 30485 raft_consensus.cc:374] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.417385 30485 raft_consensus.cc:729] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.417305 30576 raft_consensus.cc:504] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.417716 30441 raft_consensus.cc:2379] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate f40077f920074fffba17e847ebc10339 in this term.
I20240502 08:19:49.418730 30576 leader_election.cc:288] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.419097 30485 consensus_queue.cc:260] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.419752 30485 ts_tablet_manager.cc:1398] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 08:19:49.420054 30485 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.420351 30750 leader_election.cc:288] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.420886 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.421352 30292 raft_consensus.cc:3037] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.424362 30485 tablet_bootstrap.cc:654] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.424396 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.426029 30368 raft_consensus.cc:2379] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f40077f920074fffba17e847ebc10339 in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:49.424870 30333 leader_election.cc:302] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.426947 30576 raft_consensus.cc:482] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.427004 30750 raft_consensus.cc:2781] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.427075 30750 raft_consensus.cc:482] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.427127 30750 raft_consensus.cc:3037] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.427058 30576 raft_consensus.cc:504] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.427589 30576 leader_election.cc:288] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.428884 30485 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.425539 30484 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.425729 30483 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.429064 30485 ts_tablet_manager.cc:1367] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20240502 08:19:49.429997 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083a831f22ce4fad931d04fe213c14c0" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.431900 30368 raft_consensus.cc:2454] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.430116 30483 ts_tablet_manager.cc:1367] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20240502 08:19:49.432968 30483 raft_consensus.cc:348] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.433264 30483 raft_consensus.cc:374] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.433363 30483 raft_consensus.cc:729] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.433336 30192 catalog_manager.cc:5484] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.433596 30483 consensus_queue.cc:260] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.434304 30483 ts_tablet_manager.cc:1398] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.434672 30483 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.435802 30545 consensus_queue.cc:1035] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.436647 30483 tablet_bootstrap.cc:654] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.430164 30484 ts_tablet_manager.cc:1367] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.043s user 0.022s sys 0.014s
I20240502 08:19:49.438583 30408 leader_election.cc:302] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.429697 30750 raft_consensus.cc:504] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.438812 30576 raft_consensus.cc:2781] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.438892 30576 raft_consensus.cc:482] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.438948 30576 raft_consensus.cc:3037] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.439399 30750 leader_election.cc:288] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.440080 30484 raft_consensus.cc:348] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.440234 30490 consensus_queue.cc:1035] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.438407 30485 raft_consensus.cc:348] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.440330 30484 raft_consensus.cc:374] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.440637 30484 raft_consensus.cc:729] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.440932 30290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.440481 30485 raft_consensus.cc:374] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.441118 30485 raft_consensus.cc:729] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.441365 30485 consensus_queue.cc:260] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.441468 30576 raft_consensus.cc:504] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.440868 30484 consensus_queue.cc:260] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.442116 30484 ts_tablet_manager.cc:1398] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 08:19:49.442404 30576 leader_election.cc:288] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.442512 30485 ts_tablet_manager.cc:1398] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 08:19:49.442951 30485 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.443284 30290 raft_consensus.cc:3037] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.444839 30485 tablet_bootstrap.cc:654] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.445853 30750 consensus_queue.cc:1035] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.446028 30290 raft_consensus.cc:2454] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.443146 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083a831f22ce4fad931d04fe213c14c0" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.446450 30369 raft_consensus.cc:3037] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.448798 30483 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.448978 30483 ts_tablet_manager.cc:1367] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20240502 08:19:49.449707 30483 raft_consensus.cc:348] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.449955 30483 raft_consensus.cc:374] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.450042 30483 raft_consensus.cc:729] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.450291 30483 consensus_queue.cc:260] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.450894 30483 ts_tablet_manager.cc:1398] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:49.451236 30483 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.449484 30369 raft_consensus.cc:2454] T 083a831f22ce4fad931d04fe213c14c0 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.452589 30408 leader_election.cc:302] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.452818 30576 raft_consensus.cc:2781] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.452934 30576 raft_consensus.cc:686] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:49.453014 30332 leader_election.cc:302] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.453251 30555 raft_consensus.cc:2781] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.453158 30576 consensus_queue.cc:237] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.453341 30555 raft_consensus.cc:686] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.453517 30555 consensus_queue.cc:237] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.456537 30483 tablet_bootstrap.cc:654] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.458738 30485 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.458956 30485 ts_tablet_manager.cc:1367] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20240502 08:19:49.459856 30485 raft_consensus.cc:348] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.460961 30485 raft_consensus.cc:374] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.461017 30483 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.461072 30485 raft_consensus.cc:729] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.461287 30483 ts_tablet_manager.cc:1367] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20240502 08:19:49.461335 30485 consensus_queue.cc:260] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.462011 30483 raft_consensus.cc:348] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.462221 30483 raft_consensus.cc:374] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.462334 30483 raft_consensus.cc:729] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.462383 30485 ts_tablet_manager.cc:1398] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.462749 30485 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.462680 30483 consensus_queue.cc:260] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.463374 30483 ts_tablet_manager.cc:1398] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 08:19:49.463685 30483 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.463431 30192 catalog_manager.cc:5484] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.464491 30485 tablet_bootstrap.cc:654] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.465509 30483 tablet_bootstrap.cc:654] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.443228 30484 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.467146 30485 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.467334 30485 ts_tablet_manager.cc:1367] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 08:19:49.467442 30484 tablet_bootstrap.cc:654] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.468253 30485 raft_consensus.cc:348] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.468508 30485 raft_consensus.cc:374] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.468611 30485 raft_consensus.cc:729] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.468797 30290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.468885 30485 consensus_queue.cc:260] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.469170 30294 raft_consensus.cc:3037] T 309951d8b8b646988666292e5f6108e4 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.469623 30485 ts_tablet_manager.cc:1398] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:49.469736 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82577cbf65394ea1b821117762f25b58" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.469904 30441 raft_consensus.cc:2454] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.470067 30485 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.470286 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54ead505545b4095a3a020bf338a7413" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.470499 30441 raft_consensus.cc:2379] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04071db453cd4e6db9e0b3f5ad3510dc in current term 1: Already voted for candidate f40077f920074fffba17e847ebc10339 in this term.
I20240502 08:19:49.470475 30289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083a831f22ce4fad931d04fe213c14c0" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.470697 30289 raft_consensus.cc:2454] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.471623 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db55398254b48d6a96623ea9d563561" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.471782 30441 raft_consensus.cc:3037] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.472172 30485 tablet_bootstrap.cc:654] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.474889 30441 raft_consensus.cc:2454] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.474897 30483 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.475095 30483 ts_tablet_manager.cc:1367] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20240502 08:19:49.475589 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083a831f22ce4fad931d04fe213c14c0" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.475672 30333 leader_election.cc:302] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.430858 30292 raft_consensus.cc:2454] T 54ead505545b4095a3a020bf338a7413 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.476267 30483 raft_consensus.cc:348] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.476404 30554 raft_consensus.cc:2781] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.476434 30483 raft_consensus.cc:374] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.476505 30554 raft_consensus.cc:482] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.476511 30483 raft_consensus.cc:729] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.476590 30554 raft_consensus.cc:3037] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.476778 30483 consensus_queue.cc:260] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.477327 30483 ts_tablet_manager.cc:1398] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.477618 30483 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339: Bootstrap starting.
I20240502 08:19:49.477877 30406 leader_election.cc:302] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f40077f920074fffba17e847ebc10339; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.478080 30576 raft_consensus.cc:2726] T 54ead505545b4095a3a020bf338a7413 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 08:19:49.478607 30576 consensus_queue.cc:1035] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.479331 30483 tablet_bootstrap.cc:654] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.479871 30554 raft_consensus.cc:504] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.480391 30484 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.480551 30484 ts_tablet_manager.cc:1367] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.001s
I20240502 08:19:49.480666 30554 leader_election.cc:288] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.476531 30332 leader_election.cc:302] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: f40077f920074fffba17e847ebc10339
I20240502 08:19:49.481534 30484 raft_consensus.cc:348] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.482491 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82577cbf65394ea1b821117762f25b58" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.482931 30750 raft_consensus.cc:2781] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.487982 30750 raft_consensus.cc:686] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.488226 30750 consensus_queue.cc:237] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.488274 30576 consensus_queue.cc:1035] T 309951d8b8b646988666292e5f6108e4 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.483160 30294 raft_consensus.cc:3037] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.489439 30483 tablet_bootstrap.cc:492] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339: No bootstrap required, opened a new log
I20240502 08:19:49.489570 30483 ts_tablet_manager.cc:1367] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20240502 08:19:49.484740 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82577cbf65394ea1b821117762f25b58" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.490303 30483 raft_consensus.cc:348] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.490497 30483 raft_consensus.cc:374] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.490518 30441 raft_consensus.cc:3037] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.490562 30483 raft_consensus.cc:729] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40077f920074fffba17e847ebc10339, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.490746 30483 consensus_queue.cc:260] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.491436 30483 ts_tablet_manager.cc:1398] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:49.492094 30294 raft_consensus.cc:2454] T 083a831f22ce4fad931d04fe213c14c0 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.491665 30191 catalog_manager.cc:5484] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.492777 30441 raft_consensus.cc:2454] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
W20240502 08:19:49.493129 30332 leader_election.cc:341] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.494053 30333 leader_election.cc:302] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a
I20240502 08:19:49.494390 30554 raft_consensus.cc:2781] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.494510 30554 raft_consensus.cc:686] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.494707 30485 tablet_bootstrap.cc:492] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.494824 30485 ts_tablet_manager.cc:1367] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20240502 08:19:49.494738 30554 consensus_queue.cc:237] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.487777 30484 raft_consensus.cc:374] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.495195 30484 raft_consensus.cc:729] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.495440 30484 consensus_queue.cc:260] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.495467 30485 raft_consensus.cc:348] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.495698 30485 raft_consensus.cc:374] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.495769 30485 raft_consensus.cc:729] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.495942 30485 consensus_queue.cc:260] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.496085 30484 ts_tablet_manager.cc:1398] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20240502 08:19:49.496399 30484 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.496536 30485 ts_tablet_manager.cc:1398] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:49.496789 30485 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.498409 30484 tablet_bootstrap.cc:654] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.498741 30485 tablet_bootstrap.cc:654] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.498152 30189 catalog_manager.cc:5484] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.507850 30484 tablet_bootstrap.cc:492] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.508010 30484 ts_tablet_manager.cc:1367] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20240502 08:19:49.508692 30484 raft_consensus.cc:348] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.508864 30484 raft_consensus.cc:374] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.508926 30484 raft_consensus.cc:729] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.509181 30484 consensus_queue.cc:260] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.509811 30484 ts_tablet_manager.cc:1398] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 08:19:49.510071 30484 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.511708 30484 tablet_bootstrap.cc:654] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.515165 30748 consensus_queue.cc:1035] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.515862 30748 consensus_queue.cc:1035] T 357103558ce04e16867cd583542709d3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.527521 30748 consensus_queue.cc:1035] T 228dc2bad04d4a719b5ef3a991de2873 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.553568 30189 catalog_manager.cc:5484] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.566460 30655 raft_consensus.cc:482] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.566670 30655 raft_consensus.cc:504] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.567512 30655 leader_election.cc:288] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.569957 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d79a12da64188af3ca44fc7ff710f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.570147 30368 raft_consensus.cc:2454] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.570458 30484 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.570600 30484 ts_tablet_manager.cc:1367] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.061s user 0.019s sys 0.033s
I20240502 08:19:49.570801 30439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d79a12da64188af3ca44fc7ff710f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.570983 30439 raft_consensus.cc:2454] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.571408 30259 leader_election.cc:302] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.571380 30484 raft_consensus.cc:348] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.571547 30484 raft_consensus.cc:374] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.571615 30485 tablet_bootstrap.cc:492] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.571753 30485 ts_tablet_manager.cc:1367] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.075s user 0.031s sys 0.036s
I20240502 08:19:49.571622 30484 raft_consensus.cc:729] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.572120 30484 consensus_queue.cc:260] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.572440 30655 raft_consensus.cc:2781] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.572506 30655 raft_consensus.cc:482] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.572562 30655 raft_consensus.cc:3037] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.572468 30485 raft_consensus.cc:348] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.572631 30485 raft_consensus.cc:374] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.572675 30485 raft_consensus.cc:729] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.572863 30485 consensus_queue.cc:260] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.573531 30485 ts_tablet_manager.cc:1398] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.574069 30484 ts_tablet_manager.cc:1398] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.574337 30484 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.576256 30484 tablet_bootstrap.cc:654] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.576996 30485 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.577457 30655 raft_consensus.cc:504] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.578610 30485 tablet_bootstrap.cc:654] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.578634 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d79a12da64188af3ca44fc7ff710f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.578869 30368 raft_consensus.cc:3037] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.582482 30368 raft_consensus.cc:2454] T ca2d79a12da64188af3ca44fc7ff710f P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.582844 30259 leader_election.cc:302] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.583113 30490 raft_consensus.cc:2781] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.583243 30490 raft_consensus.cc:686] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:49.583480 30490 consensus_queue.cc:237] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.583634 30484 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.583776 30484 ts_tablet_manager.cc:1367] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20240502 08:19:49.584515 30484 raft_consensus.cc:348] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.584697 30484 raft_consensus.cc:374] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.584758 30484 raft_consensus.cc:729] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.584961 30484 consensus_queue.cc:260] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.585134 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d79a12da64188af3ca44fc7ff710f" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.585291 30438 raft_consensus.cc:3037] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.586709 30484 ts_tablet_manager.cc:1398] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 08:19:49.586755 30485 tablet_bootstrap.cc:492] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.586881 30485 ts_tablet_manager.cc:1367] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240502 08:19:49.586989 30484 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Bootstrap starting.
I20240502 08:19:49.587718 30485 raft_consensus.cc:348] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.587975 30438 raft_consensus.cc:2454] T ca2d79a12da64188af3ca44fc7ff710f P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.587967 30485 raft_consensus.cc:374] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.588255 30485 raft_consensus.cc:729] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.588475 30485 consensus_queue.cc:260] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.588747 30484 tablet_bootstrap.cc:654] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.588966 30485 ts_tablet_manager.cc:1398] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:49.589223 30485 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.590109 30748 raft_consensus.cc:482] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.590236 30748 raft_consensus.cc:504] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.590793 30485 tablet_bootstrap.cc:654] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.590883 30748 leader_election.cc:288] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.591555 30438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b172de19443e4af4a32e5ca5756794e8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.591738 30438 raft_consensus.cc:2454] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.591418 30192 catalog_manager.cc:5484] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.592092 30294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b172de19443e4af4a32e5ca5756794e8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.592144 30333 leader_election.cc:302] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.592262 30294 raft_consensus.cc:2454] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.592646 30554 raft_consensus.cc:2781] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.592730 30554 raft_consensus.cc:482] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.592814 30554 raft_consensus.cc:3037] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.595291 30554 raft_consensus.cc:504] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.595835 30554 leader_election.cc:288] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.592741 30655 leader_election.cc:288] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.596290 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b172de19443e4af4a32e5ca5756794e8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.596496 30441 raft_consensus.cc:3037] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.600348 30441 raft_consensus.cc:2454] T b172de19443e4af4a32e5ca5756794e8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.600565 30484 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc: No bootstrap required, opened a new log
I20240502 08:19:49.600515 30576 raft_consensus.cc:482] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.600669 30484 ts_tablet_manager.cc:1367] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.002s
I20240502 08:19:49.600685 30576 raft_consensus.cc:504] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.601329 30484 raft_consensus.cc:348] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.601456 30484 raft_consensus.cc:374] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.601488 30484 raft_consensus.cc:729] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.601564 30576 leader_election.cc:288] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.601631 30484 consensus_queue.cc:260] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.602100 30333 leader_election.cc:302] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.602283 30484 ts_tablet_manager.cc:1398] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 08:19:49.602519 30554 raft_consensus.cc:2781] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.602645 30554 raft_consensus.cc:686] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.602888 30554 consensus_queue.cc:237] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.605333 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b172de19443e4af4a32e5ca5756794e8" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.605525 30292 raft_consensus.cc:3037] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.605700 30748 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.607892 30490 raft_consensus.cc:482] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.608070 30490 raft_consensus.cc:504] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.608206 30292 raft_consensus.cc:2454] T b172de19443e4af4a32e5ca5756794e8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.608588 30749 raft_consensus.cc:482] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.608722 30490 leader_election.cc:288] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.608779 30749 raft_consensus.cc:504] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.609341 30749 leader_election.cc:288] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.609750 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.610013 30441 raft_consensus.cc:2379] T afe8cb04769648e88f7022b059fda39b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in current term 1: Already voted for candidate 04071db453cd4e6db9e0b3f5ad3510dc in this term.
I20240502 08:19:49.610697 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe8cb04769648e88f7022b059fda39b" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.610801 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "268827f2a34a425fb7e9c9d4c0f89a96" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.610965 30368 raft_consensus.cc:2454] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.611222 30259 leader_election.cc:302] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339
I20240502 08:19:49.611725 30490 raft_consensus.cc:3037] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.611764 30485 tablet_bootstrap.cc:492] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.611918 30485 ts_tablet_manager.cc:1367] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.005s
I20240502 08:19:49.612713 30485 raft_consensus.cc:348] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.612913 30485 raft_consensus.cc:374] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.613006 30485 raft_consensus.cc:729] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.613248 30485 consensus_queue.cc:260] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.613868 30485 ts_tablet_manager.cc:1398] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 08:19:49.614168 30485 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.614249 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "268827f2a34a425fb7e9c9d4c0f89a96" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.614466 30292 raft_consensus.cc:2454] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.614735 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6477f72163a94f1bb0381fb2f453f6f2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.614933 30441 raft_consensus.cc:2454] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 0.
I20240502 08:19:49.615612 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6477f72163a94f1bb0381fb2f453f6f2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.615957 30485 tablet_bootstrap.cc:654] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.616112 30408 leader_election.cc:302] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.616420 30576 raft_consensus.cc:2781] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.616525 30576 raft_consensus.cc:482] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.616312 30192 catalog_manager.cc:5484] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.616611 30576 raft_consensus.cc:3037] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.617542 30333 leader_election.cc:302] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.617811 30554 raft_consensus.cc:2781] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.617807 30485 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.617941 30554 raft_consensus.cc:482] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.618042 30554 raft_consensus.cc:3037] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.618049 30485 ts_tablet_manager.cc:1367] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240502 08:19:49.618865 30485 raft_consensus.cc:348] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.619073 30485 raft_consensus.cc:374] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.619158 30485 raft_consensus.cc:729] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.619488 30576 raft_consensus.cc:504] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.619552 30485 consensus_queue.cc:260] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.620175 30485 ts_tablet_manager.cc:1398] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:49.620508 30485 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Bootstrap starting.
I20240502 08:19:49.620661 30554 raft_consensus.cc:504] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
W20240502 08:19:49.621908 30332 leader_election.cc:341] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): Illegal state: must be running to vote when last-logged opid is not known
I20240502 08:19:49.622143 30485 tablet_bootstrap.cc:654] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Neither blocks nor log segments found. Creating new log.
I20240502 08:19:49.622392 30748 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.623844 30651 consensus_queue.cc:1035] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.624017 30485 tablet_bootstrap.cc:492] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: No bootstrap required, opened a new log
I20240502 08:19:49.624161 30485 ts_tablet_manager.cc:1367] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 08:19:49.624961 30485 raft_consensus.cc:348] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.625188 30485 raft_consensus.cc:374] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:19:49.625314 30485 raft_consensus.cc:729] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Initialized, Role: FOLLOWER
I20240502 08:19:49.625625 30554 leader_election.cc:288] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.625519 30485 consensus_queue.cc:260] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.627467 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6477f72163a94f1bb0381fb2f453f6f2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.627650 30442 raft_consensus.cc:3037] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.630872 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "268827f2a34a425fb7e9c9d4c0f89a96" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.630892 30488 consensus_queue.cc:1035] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240502 08:19:49.633602 30545 consensus_queue.cc:1035] T e57d2d37396543d6bbfb2e16edc75b7d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.634862 30368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "268827f2a34a425fb7e9c9d4c0f89a96" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.635169 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6477f72163a94f1bb0381fb2f453f6f2" candidate_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.635300 30490 raft_consensus.cc:2726] T afe8cb04769648e88f7022b059fda39b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 08:19:49.635424 30576 leader_election.cc:288] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.635877 30485 ts_tablet_manager.cc:1398] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 08:19:49.635953 30607 consensus_queue.cc:1035] T 1acd903a90d04ba3b1496480bcbcc9d7 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240502 08:19:49.636409 30368 raft_consensus.cc:3037] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.637715 30292 raft_consensus.cc:3037] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.637748 30291 raft_consensus.cc:3037] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.645701 30607 raft_consensus.cc:482] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.647850 30368 raft_consensus.cc:2454] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.647876 30292 raft_consensus.cc:2454] T 268827f2a34a425fb7e9c9d4c0f89a96 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.648154 30442 raft_consensus.cc:2454] T 6477f72163a94f1bb0381fb2f453f6f2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.648751 30406 leader_election.cc:302] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.648980 30607 raft_consensus.cc:504] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.650099 30333 leader_election.cc:302] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.650297 30607 leader_election.cc:288] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.651098 30291 raft_consensus.cc:2454] T 6477f72163a94f1bb0381fb2f453f6f2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04071db453cd4e6db9e0b3f5ad3510dc in term 1.
I20240502 08:19:49.651736 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2388853f54579b5971df47dc41618" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.651950 30366 raft_consensus.cc:2454] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.652132 30488 raft_consensus.cc:2781] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.653137 30488 raft_consensus.cc:686] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:49.653421 30488 consensus_queue.cc:237] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.654536 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2388853f54579b5971df47dc41618" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" is_pre_election: true
I20240502 08:19:49.654767 30292 raft_consensus.cc:2454] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 0.
I20240502 08:19:49.655413 30749 raft_consensus.cc:2781] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.655615 30749 raft_consensus.cc:686] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Becoming Leader. State: Replica: 04071db453cd4e6db9e0b3f5ad3510dc, State: Running, Role: LEADER
I20240502 08:19:49.656121 30749 consensus_queue.cc:237] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.657290 30408 leader_election.cc:302] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.657732 30576 raft_consensus.cc:2781] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.657846 30576 raft_consensus.cc:482] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.658061 30576 raft_consensus.cc:3037] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.659201 30490 raft_consensus.cc:482] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.659377 30490 raft_consensus.cc:504] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.661060 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756a969437e74599a39cc9c2c38c7e9c" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.661073 30490 leader_election.cc:288] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.661665 30442 raft_consensus.cc:2454] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.662097 30258 leader_election.cc:302] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.662632 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756a969437e74599a39cc9c2c38c7e9c" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.662858 30366 raft_consensus.cc:2454] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.663141 30490 raft_consensus.cc:2781] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.663287 30490 raft_consensus.cc:482] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.663393 30490 raft_consensus.cc:3037] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.669034 30490 raft_consensus.cc:504] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.670874 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756a969437e74599a39cc9c2c38c7e9c" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.671082 30366 raft_consensus.cc:3037] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.671638 30576 raft_consensus.cc:504] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.671902 30490 leader_election.cc:288] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.673365 30576 leader_election.cc:288] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Requested vote from peers 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355), 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:49.674054 30366 raft_consensus.cc:2454] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.674950 30259 leader_election.cc:302] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.670874 30442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756a969437e74599a39cc9c2c38c7e9c" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.675638 30442 raft_consensus.cc:3037] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.678647 30291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2388853f54579b5971df47dc41618" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a"
I20240502 08:19:49.678882 30291 raft_consensus.cc:3037] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.682209 30366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2388853f54579b5971df47dc41618" candidate_uuid: "f40077f920074fffba17e847ebc10339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.684262 30545 raft_consensus.cc:2781] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.686529 30442 raft_consensus.cc:2454] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.691879 30545 raft_consensus.cc:686] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:49.692684 30366 raft_consensus.cc:3037] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.696892 30545 consensus_queue.cc:237] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.697587 30291 raft_consensus.cc:2454] T b1c2388853f54579b5971df47dc41618 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.699033 30366 raft_consensus.cc:2454] T b1c2388853f54579b5971df47dc41618 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f40077f920074fffba17e847ebc10339 in term 1.
I20240502 08:19:49.699499 30406 leader_election.cc:302] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e8e9c9d7b141e6a7c8f76490ec0c1a, f40077f920074fffba17e847ebc10339; no voters:
I20240502 08:19:49.699913 30488 raft_consensus.cc:2781] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.700114 30488 raft_consensus.cc:686] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Becoming Leader. State: Replica: f40077f920074fffba17e847ebc10339, State: Running, Role: LEADER
I20240502 08:19:49.700484 30488 consensus_queue.cc:237] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.698786 30192 catalog_manager.cc:5484] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.705282 30554 consensus_queue.cc:1035] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.709856 30192 catalog_manager.cc:5484] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.711894 30191 catalog_manager.cc:5484] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130). New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.719817 30555 consensus_queue.cc:1035] T afe8cb04769648e88f7022b059fda39b P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.721122 30192 catalog_manager.cc:5484] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 reported cstate change: term changed from 0 to 1, leader changed from <none> to f40077f920074fffba17e847ebc10339 (127.28.130.131). New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } }
I20240502 08:19:49.777592 30441 raft_consensus.cc:3037] T 6e47d748c7f24cba9f9e1ec2e91b8136 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.780192 30555 consensus_queue.cc:1035] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.785076 30554 consensus_queue.cc:1035] T 6e47d748c7f24cba9f9e1ec2e91b8136 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.796778 30545 consensus_queue.cc:1035] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.800606 30655 consensus_queue.cc:1035] T 6b9f87872b36437fa743b50dd0c53ce8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.860775 30554 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.864248 30554 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.873117 30554 consensus_queue.cc:1035] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.876600 30498 consensus_queue.cc:1035] T 54ead505545b4095a3a020bf338a7413 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.904372 30488 consensus_queue.cc:1035] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.908283 30488 consensus_queue.cc:1035] T 083a831f22ce4fad931d04fe213c14c0 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.934172 30655 raft_consensus.cc:482] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 08:19:49.934310 30655 raft_consensus.cc:504] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.934937 30655 leader_election.cc:288] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.935225 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" is_pre_election: true
I20240502 08:19:49.935384 30367 raft_consensus.cc:2454] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.935338 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339" is_pre_election: true
I20240502 08:19:49.935523 30441 raft_consensus.cc:2454] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 0.
I20240502 08:19:49.935750 30259 leader_election.cc:302] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.935977 30655 raft_consensus.cc:2781] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 08:19:49.936044 30655 raft_consensus.cc:482] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 08:19:49.936111 30655 raft_consensus.cc:3037] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.937935 30655 raft_consensus.cc:504] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.938459 30655 leader_election.cc:288] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Requested vote from peers 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055), f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:49.938697 30367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04071db453cd4e6db9e0b3f5ad3510dc"
I20240502 08:19:49.938823 30367 raft_consensus.cc:3037] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.938799 30441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b52ae043b824aea9065625ac834ce22" candidate_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f40077f920074fffba17e847ebc10339"
I20240502 08:19:49.938933 30441 raft_consensus.cc:3037] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:49.940620 30441 raft_consensus.cc:2454] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.940659 30367 raft_consensus.cc:2454] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e8e9c9d7b141e6a7c8f76490ec0c1a in term 1.
I20240502 08:19:49.941035 30259 leader_election.cc:302] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04071db453cd4e6db9e0b3f5ad3510dc, 04e8e9c9d7b141e6a7c8f76490ec0c1a; no voters:
I20240502 08:19:49.941247 30655 raft_consensus.cc:2781] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:19:49.941380 30655 raft_consensus.cc:686] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Becoming Leader. State: Replica: 04e8e9c9d7b141e6a7c8f76490ec0c1a, State: Running, Role: LEADER
I20240502 08:19:49.941599 30655 consensus_queue.cc:237] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } }
I20240502 08:19:49.944311 30189 catalog_manager.cc:5484] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129). New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:49.978760 30490 consensus_queue.cc:1035] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:49.983105 30490 consensus_queue.cc:1035] T ca2d79a12da64188af3ca44fc7ff710f P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.029125 30498 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.035583 30291 raft_consensus.cc:3037] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:19:50.035624 30555 consensus_queue.cc:1035] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.039141 30555 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.042807 30555 consensus_queue.cc:1035] T 6477f72163a94f1bb0381fb2f453f6f2 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.083853 30655 consensus_queue.cc:1035] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.087610 30490 consensus_queue.cc:1035] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.097641 30554 consensus_queue.cc:1035] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.101032 30498 consensus_queue.cc:1035] T b172de19443e4af4a32e5ca5756794e8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.166929 30576 consensus_queue.cc:1035] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.170290 30607 consensus_queue.cc:1035] T 268827f2a34a425fb7e9c9d4c0f89a96 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.273442 30607 consensus_queue.cc:1035] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.275200 30607 consensus_queue.cc:1035] T b1c2388853f54579b5971df47dc41618 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.409878 30490 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.414047 30556 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 08:19:50.732662 29194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:19:50.735554 30881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:50.755878 30882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:19:50.756562 30884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:19:50.757109 29194 server_base.cc:1034] running on GCE node
I20240502 08:19:50.757453 29194 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:19:50.757586 29194 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:19:50.757642 29194 hybrid_clock.cc:648] HybridClock initialized: now 1714637990757626 us; error 0 us; skew 500 ppm
I20240502 08:19:50.757783 29194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:19:50.759096 29194 webserver.cc:460] Webserver started at http://127.28.130.132:40319/ using document root <none> and password file <none>
I20240502 08:19:50.759303 29194 fs_manager.cc:359] Metadata directory not provided
I20240502 08:19:50.759369 29194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:19:50.759502 29194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:19:50.760140 29194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-3-root/instance:
uuid: "c86cd001c4794460b702b3d76e8efcab"
format_stamp: "Formatted at 2024-05-02 08:19:50 on dist-test-slave-330p"
I20240502 08:19:50.762972 29194 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20240502 08:19:50.764847 30889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:50.765141 29194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 08:19:50.765224 29194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-3-root
uuid: "c86cd001c4794460b702b3d76e8efcab"
format_stamp: "Formatted at 2024-05-02 08:19:50 on dist-test-slave-330p"
I20240502 08:19:50.765321 29194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:19:50.777832 29194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 08:19:50.778295 29194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:19:50.778820 29194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:19:50.779613 29194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:19:50.779667 29194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:50.779728 29194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:19:50.779757 29194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 08:19:50.793640 29194 rpc_server.cc:307] RPC server started. Bound to: 127.28.130.132:46425
I20240502 08:19:50.793658 30951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.130.132:46425 every 8 connection(s)
I20240502 08:19:50.794631 29194 auto_leader_rebalancer-test.cc:405] add a tserver: c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:50.800707 30952 heartbeater.cc:347] Connected to a master server at 127.28.130.190:36393
I20240502 08:19:50.800841 30952 heartbeater.cc:464] Registering TS with master...
I20240502 08:19:50.801155 30952 heartbeater.cc:511] Master 127.28.130.190:36393 requested a full tablet report, sending...
I20240502 08:19:50.802016 30190 ts_manager.cc:194] Registered new tserver with Master: c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425)
I20240502 08:19:50.802799 30190 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58732
I20240502 08:19:51.303633 30369 consensus_queue.cc:237] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.306231 30438 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.306205 30291 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.307430 30960 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20240502 08:19:51.308179 30498 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.311779 30960 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.312487 30438 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.314447 30291 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.318799 30190 catalog_manager.cc:5484] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 08:19:51.325004 30335 consensus_peers.cc:485] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1c63644a39642eeae800e736bdfebe3. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:51.328806 30291 consensus_queue.cc:237] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.331476 30438 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.331815 30369 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.332002 30655 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.332659 30655 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.334774 30655 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.335420 30438 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
W20240502 08:19:51.338434 30260 consensus_peers.cc:485] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b52ae043b824aea9065625ac834ce22. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:51.341166 30369 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.341929 30190 catalog_manager.cc:5484] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:51.349848 30438 consensus_queue.cc:237] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.353052 30291 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.353634 30488 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.354779 30369 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.355618 30488 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.362619 30488 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.370313 30367 consensus_queue.cc:237] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.371326 30291 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.372866 30441 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.373175 30292 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:51.373356 30749 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:51.373700 30498 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 08:19:51.374882 30335 consensus_peers.cc:485] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e636180fea54536809d2981178098d8. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:51.382200 30190 catalog_manager.cc:5484] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.386910 30369 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.390012 30960 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.390475 30292 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.397317 30438 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:51.403331 30192 catalog_manager.cc:5484] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
W20240502 08:19:51.407713 30409 consensus_peers.cc:485] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bee358532964d899a5a3d6494b391e2. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:51.757391 30981 ts_tablet_manager.cc:902] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:51.759205 30981 tablet_copy_client.cc:308] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.130:38055
I20240502 08:19:51.766016 30379 tablet_copy_service.cc:140] P 04071db453cd4e6db9e0b3f5ad3510dc: Received BeginTabletCopySession request for tablet d1c63644a39642eeae800e736bdfebe3 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:38308)
I20240502 08:19:51.766183 30379 tablet_copy_service.cc:161] P 04071db453cd4e6db9e0b3f5ad3510dc: Beginning new tablet copy session on tablet d1c63644a39642eeae800e736bdfebe3 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:38308: session id = c86cd001c4794460b702b3d76e8efcab-d1c63644a39642eeae800e736bdfebe3
I20240502 08:19:51.769019 30379 tablet_copy_source_session.cc:205] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:51.770879 30981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1c63644a39642eeae800e736bdfebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:51.776978 30981 tablet_copy_client.cc:783] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:51.777312 30981 tablet_copy_client.cc:647] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:51.779606 30981 tablet_copy_client.cc:523] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:51.783257 30981 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:51.791033 30981 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:51.791430 30981 tablet_bootstrap.cc:492] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:51.791684 30981 ts_tablet_manager.cc:1367] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.002s
I20240502 08:19:51.792419 30981 raft_consensus.cc:348] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.792627 30981 raft_consensus.cc:729] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:51.792791 30981 consensus_queue.cc:260] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.793582 30952 heartbeater.cc:503] Master 127.28.130.190:36393 was elected leader, sending a full tablet report...
I20240502 08:19:51.793608 30981 ts_tablet_manager.cc:1398] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240502 08:19:51.794391 30379 tablet_copy_service.cc:342] P 04071db453cd4e6db9e0b3f5ad3510dc: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-d1c63644a39642eeae800e736bdfebe3 received from {username='slave'} at 127.0.0.1:38308
I20240502 08:19:51.794535 30379 tablet_copy_service.cc:433] P 04071db453cd4e6db9e0b3f5ad3510dc: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-d1c63644a39642eeae800e736bdfebe3 on tablet d1c63644a39642eeae800e736bdfebe3 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:51.815471 30981 ts_tablet_manager.cc:902] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer f40077f920074fffba17e847ebc10339 (127.28.130.131:34581)
I20240502 08:19:51.816758 30981 tablet_copy_client.cc:308] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.131:34581
I20240502 08:19:51.823849 30453 tablet_copy_service.cc:140] P f40077f920074fffba17e847ebc10339: Received BeginTabletCopySession request for tablet 3bee358532964d899a5a3d6494b391e2 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:53496)
I20240502 08:19:51.824015 30453 tablet_copy_service.cc:161] P f40077f920074fffba17e847ebc10339: Beginning new tablet copy session on tablet 3bee358532964d899a5a3d6494b391e2 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:53496: session id = c86cd001c4794460b702b3d76e8efcab-3bee358532964d899a5a3d6494b391e2
I20240502 08:19:51.826560 30453 tablet_copy_source_session.cc:205] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:51.827769 30981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bee358532964d899a5a3d6494b391e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:51.833444 30981 tablet_copy_client.cc:783] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:51.833689 30981 tablet_copy_client.cc:647] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:51.835608 30981 tablet_copy_client.cc:523] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:51.839057 30981 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:51.843874 30981 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:51.844205 30981 tablet_bootstrap.cc:492] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:51.844415 30981 ts_tablet_manager.cc:1367] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20240502 08:19:51.844969 30981 raft_consensus.cc:348] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.845140 30981 raft_consensus.cc:729] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:51.845322 30981 consensus_queue.cc:260] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.845997 30981 ts_tablet_manager.cc:1398] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 08:19:51.846580 30453 tablet_copy_service.cc:342] P f40077f920074fffba17e847ebc10339: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-3bee358532964d899a5a3d6494b391e2 received from {username='slave'} at 127.0.0.1:53496
I20240502 08:19:51.846681 30453 tablet_copy_service.cc:433] P f40077f920074fffba17e847ebc10339: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-3bee358532964d899a5a3d6494b391e2 on tablet 3bee358532964d899a5a3d6494b391e2 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:51.851287 30981 ts_tablet_manager.cc:902] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:51.853327 30981 tablet_copy_client.cc:308] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.130:38055
I20240502 08:19:51.853932 30379 tablet_copy_service.cc:140] P 04071db453cd4e6db9e0b3f5ad3510dc: Received BeginTabletCopySession request for tablet 9e636180fea54536809d2981178098d8 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:38308)
I20240502 08:19:51.854048 30379 tablet_copy_service.cc:161] P 04071db453cd4e6db9e0b3f5ad3510dc: Beginning new tablet copy session on tablet 9e636180fea54536809d2981178098d8 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:38308: session id = c86cd001c4794460b702b3d76e8efcab-9e636180fea54536809d2981178098d8
I20240502 08:19:51.856403 30379 tablet_copy_source_session.cc:205] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:51.857600 30981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e636180fea54536809d2981178098d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:51.862808 30981 tablet_copy_client.cc:783] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:51.863015 30981 tablet_copy_client.cc:647] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:51.864451 30981 tablet_copy_client.cc:523] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:51.868537 30981 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:51.877970 30998 ts_tablet_manager.cc:902] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:51.881016 30981 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:51.881417 30981 tablet_bootstrap.cc:492] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:51.881672 30981 ts_tablet_manager.cc:1367] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20240502 08:19:51.882400 30981 raft_consensus.cc:348] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.882669 30981 raft_consensus.cc:729] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:51.882674 30998 tablet_copy_client.cc:308] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:51.882880 30981 consensus_queue.cc:260] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.883399 30981 ts_tablet_manager.cc:1398] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240502 08:19:51.885376 30379 tablet_copy_service.cc:342] P 04071db453cd4e6db9e0b3f5ad3510dc: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-9e636180fea54536809d2981178098d8 received from {username='slave'} at 127.0.0.1:38308
I20240502 08:19:51.885457 30379 tablet_copy_service.cc:433] P 04071db453cd4e6db9e0b3f5ad3510dc: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-9e636180fea54536809d2981178098d8 on tablet 9e636180fea54536809d2981178098d8 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:51.890691 30304 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet 1b52ae043b824aea9065625ac834ce22 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:51.890831 30304 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet 1b52ae043b824aea9065625ac834ce22 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-1b52ae043b824aea9065625ac834ce22
I20240502 08:19:51.893064 30304 tablet_copy_source_session.cc:205] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:51.894104 30998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b52ae043b824aea9065625ac834ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:51.900521 30998 tablet_copy_client.cc:783] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:51.900823 30998 tablet_copy_client.cc:647] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:51.902324 30998 tablet_copy_client.cc:523] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:51.905845 30998 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:51.912431 30998 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:51.912878 30998 tablet_bootstrap.cc:492] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:51.913151 30998 ts_tablet_manager.cc:1367] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20240502 08:19:51.913939 30998 raft_consensus.cc:348] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.914211 30998 raft_consensus.cc:729] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:51.914472 30998 consensus_queue.cc:260] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:51.915045 30998 ts_tablet_manager.cc:1398] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:51.915802 30304 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-1b52ae043b824aea9065625ac834ce22 received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:51.915911 30304 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-1b52ae043b824aea9065625ac834ce22 on tablet 1b52ae043b824aea9065625ac834ce22 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:52.344252 30927 raft_consensus.cc:1203] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:52.380137 30927 raft_consensus.cc:1203] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:52.412467 30927 raft_consensus.cc:1203] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:52.423564 30927 raft_consensus.cc:1203] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:52.803033 30960 raft_consensus.cc:1050] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:52.803942 30960 consensus_queue.cc:237] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.806083 30927 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.806108 30291 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.806641 30749 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.807144 30441 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.807354 31007 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.809002 31007 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.816596 31009 raft_consensus.cc:1050] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:52.817822 31009 consensus_queue.cc:237] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.822573 31007 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.823730 30926 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.823562 30927 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.824258 30974 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.827095 30292 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.826959 30291 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.827718 30974 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.830338 30442 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.830880 30368 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.831734 31009 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.830369 30190 catalog_manager.cc:5484] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:52.836514 31009 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.838850 30367 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.841576 30926 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.841780 30189 catalog_manager.cc:5484] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:52.851184 30294 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.858296 30367 consensus_queue.cc:237] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.860546 30926 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:52.861171 31011 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:52.863034 30438 consensus_queue.cc:237] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.863726 30960 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.865321 30926 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:52.865370 30294 raft_consensus.cc:1261] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer f40077f920074fffba17e847ebc10339: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:52.865785 31009 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:52.866043 31008 consensus_queue.cc:1035] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:52.869205 31008 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.869866 30178 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d1c63644a39642eeae800e736bdfebe3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:52.870958 30292 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.873953 30177 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3bee358532964d899a5a3d6494b391e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:52.874909 30926 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.875097 30927 raft_consensus.cc:2932] T 3bee358532964d899a5a3d6494b391e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.876180 30190 catalog_manager.cc:5484] T 3bee358532964d899a5a3d6494b391e2 P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New cstate: current_term: 1 leader_uuid: "f40077f920074fffba17e847ebc10339" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:52.879637 30191 catalog_manager.cc:5484] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:52.880741 30355 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bee358532964d899a5a3d6494b391e2 with delete_type TABLET_DATA_TOMBSTONED (TS 04071db453cd4e6db9e0b3f5ad3510dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38270
I20240502 08:19:52.881531 30442 raft_consensus.cc:1261] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:52.883037 31007 consensus_queue.cc:1035] T d1c63644a39642eeae800e736bdfebe3 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:52.884529 30442 raft_consensus.cc:2932] T d1c63644a39642eeae800e736bdfebe3 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.888963 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet d1c63644a39642eeae800e736bdfebe3 with delete_type TABLET_DATA_TOMBSTONED (TS 04e8e9c9d7b141e6a7c8f76490ec0c1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57230
I20240502 08:19:52.891693 31026 tablet_replica.cc:330] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: stopping tablet replica
I20240502 08:19:52.892032 31026 raft_consensus.cc:2229] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:52.892325 31026 raft_consensus.cc:2258] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:52.894754 31026 ts_tablet_manager.cc:1875] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:52.898701 31025 tablet_replica.cc:330] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: stopping tablet replica
I20240502 08:19:52.898895 31025 raft_consensus.cc:2229] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:52.899124 31025 raft_consensus.cc:2258] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:52.900089 31025 ts_tablet_manager.cc:1875] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:52.903429 31026 ts_tablet_manager.cc:1888] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:52.903564 31026 log.cc:1196] T d1c63644a39642eeae800e736bdfebe3 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/wals/d1c63644a39642eeae800e736bdfebe3
I20240502 08:19:52.904335 30176 catalog_manager.cc:4830] TS 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): tablet d1c63644a39642eeae800e736bdfebe3 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:52.907358 31025 ts_tablet_manager.cc:1888] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:52.907454 31025 log.cc:1196] T 3bee358532964d899a5a3d6494b391e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/wals/3bee358532964d899a5a3d6494b391e2
I20240502 08:19:52.908093 30178 catalog_manager.cc:4830] TS 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): tablet 3bee358532964d899a5a3d6494b391e2 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:52.963963 30556 raft_consensus.cc:1050] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:52.964711 30556 consensus_queue.cc:237] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.967128 30926 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.967411 30442 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.967602 30655 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.968102 30655 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.972596 31031 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.974557 30926 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.981693 30189 catalog_manager.cc:5484] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.981719 30441 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.983310 30368 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.983857 31032 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.985535 30368 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.988809 31011 raft_consensus.cc:1050] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:52.989607 31011 consensus_queue.cc:237] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:52.993523 30926 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.994045 31007 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.994179 30294 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.995090 31007 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.995580 30442 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:52.996049 31007 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:52.998270 31011 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:52.999217 30292 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.003029 30926 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.004174 30191 catalog_manager.cc:5484] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:53.005805 30442 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.015089 30368 consensus_queue.cc:237] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:53.016927 30926 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:53.016947 30442 raft_consensus.cc:1261] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:53.017441 30960 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:53.017750 31007 consensus_queue.cc:1035] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:53.020157 30749 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.020699 30926 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.024425 30178 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9e636180fea54536809d2981178098d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:53.023854 30442 raft_consensus.cc:2932] T 9e636180fea54536809d2981178098d8 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.025332 30189 catalog_manager.cc:5484] T 9e636180fea54536809d2981178098d8 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.029872 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e636180fea54536809d2981178098d8 with delete_type TABLET_DATA_TOMBSTONED (TS 04e8e9c9d7b141e6a7c8f76490ec0c1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57230
I20240502 08:19:53.030189 31026 tablet_replica.cc:330] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: stopping tablet replica
I20240502 08:19:53.030439 31026 raft_consensus.cc:2229] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:53.030689 31026 raft_consensus.cc:2258] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:53.031620 31026 ts_tablet_manager.cc:1875] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:53.036362 31026 ts_tablet_manager.cc:1888] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:53.036453 31026 log.cc:1196] T 9e636180fea54536809d2981178098d8 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/wals/9e636180fea54536809d2981178098d8
I20240502 08:19:53.037099 30176 catalog_manager.cc:4830] TS 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): tablet 9e636180fea54536809d2981178098d8 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:53.404722 30292 consensus_queue.cc:237] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:53.406440 30367 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:53.406440 30926 raft_consensus.cc:1261] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:53.407020 31031 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:53.407331 30655 consensus_queue.cc:1035] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:53.409736 31028 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.410341 30926 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.410694 30367 raft_consensus.cc:2932] T 1b52ae043b824aea9065625ac834ce22 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.414410 30189 catalog_manager.cc:5484] T 1b52ae043b824aea9065625ac834ce22 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:53.414872 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1b52ae043b824aea9065625ac834ce22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:53.418496 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b52ae043b824aea9065625ac834ce22 with delete_type TABLET_DATA_TOMBSTONED (TS f40077f920074fffba17e847ebc10339 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53446
I20240502 08:19:53.419193 31038 tablet_replica.cc:330] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: stopping tablet replica
I20240502 08:19:53.419411 31038 raft_consensus.cc:2229] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:53.419642 31038 raft_consensus.cc:2258] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:53.420310 31038 ts_tablet_manager.cc:1875] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:53.424436 31038 ts_tablet_manager.cc:1888] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:53.424544 31038 log.cc:1196] T 1b52ae043b824aea9065625ac834ce22 P f40077f920074fffba17e847ebc10339: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/wals/1b52ae043b824aea9065625ac834ce22
I20240502 08:19:53.425127 30177 catalog_manager.cc:4830] TS f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): tablet 1b52ae043b824aea9065625ac834ce22 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:54.433169 30292 consensus_queue.cc:237] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.435657 30441 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.435741 30368 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:54.436100 30260 consensus_peers.cc:485] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d51ec2cb58b4422ea5872093467ddd3d. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:54.436146 31042 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.436456 31028 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.439221 31042 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.439658 30442 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.439779 30368 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.445799 30192 catalog_manager.cc:5484] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.451155 30292 consensus_queue.cc:237] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.455013 30442 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.455066 30368 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:54.455019 30260 consensus_peers.cc:485] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59692a88df104ec2ad428f6b097422ec. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:54.455569 31028 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.457458 31028 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.458254 30556 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.460896 30442 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.462046 30368 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.465113 30292 consensus_queue.cc:237] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.466825 30191 catalog_manager.cc:5484] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
W20240502 08:19:54.470429 30260 consensus_peers.cc:485] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a130bd930dd34683b20eebf600797fee. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:54.470763 30442 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.470928 30368 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.471197 30556 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.471446 31045 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.474167 30556 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.475373 30442 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.477499 30368 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.478710 30369 consensus_queue.cc:237] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.479126 30192 catalog_manager.cc:5484] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:54.482446 30442 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.482568 30294 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:54.482914 30960 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:54.484064 30960 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 08:19:54.485080 30335 consensus_peers.cc:485] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d0b3dae38b54620abb75200b4b421ec. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:54.486497 30960 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.486932 30442 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.492084 30191 catalog_manager.cc:5484] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:54.497334 30294 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:54.879245 31059 ts_tablet_manager.cc:902] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:54.881045 31059 tablet_copy_client.cc:308] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:54.881704 30304 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet d51ec2cb58b4422ea5872093467ddd3d from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:54.881834 30304 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet d51ec2cb58b4422ea5872093467ddd3d from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-d51ec2cb58b4422ea5872093467ddd3d
I20240502 08:19:54.884481 30304 tablet_copy_source_session.cc:205] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:54.885581 31059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d51ec2cb58b4422ea5872093467ddd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:54.890873 31059 tablet_copy_client.cc:783] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:54.891216 31059 tablet_copy_client.cc:647] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:54.892642 31059 tablet_copy_client.cc:523] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:54.895741 31059 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:54.901461 31059 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:54.901876 31059 tablet_bootstrap.cc:492] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:54.902140 31059 ts_tablet_manager.cc:1367] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20240502 08:19:54.902848 31059 raft_consensus.cc:348] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.903087 31059 raft_consensus.cc:729] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:54.903290 31059 consensus_queue.cc:260] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.904028 31059 ts_tablet_manager.cc:1398] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240502 08:19:54.904978 31066 ts_tablet_manager.cc:902] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:54.906544 31066 tablet_copy_client.cc:308] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:54.907069 30304 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-d51ec2cb58b4422ea5872093467ddd3d received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:54.907181 30304 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-d51ec2cb58b4422ea5872093467ddd3d on tablet d51ec2cb58b4422ea5872093467ddd3d with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:54.907214 30303 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet a130bd930dd34683b20eebf600797fee from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:54.907433 30303 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet a130bd930dd34683b20eebf600797fee from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-a130bd930dd34683b20eebf600797fee
I20240502 08:19:54.909550 30303 tablet_copy_source_session.cc:205] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:54.910670 31066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a130bd930dd34683b20eebf600797fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:54.916324 31066 tablet_copy_client.cc:783] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:54.916636 31066 tablet_copy_client.cc:647] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:54.918308 31066 tablet_copy_client.cc:523] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:54.921605 31066 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:54.927234 31066 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:54.927639 31066 tablet_bootstrap.cc:492] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:54.927886 31066 ts_tablet_manager.cc:1367] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.006s user 0.008s sys 0.000s
I20240502 08:19:54.928602 31066 raft_consensus.cc:348] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.928795 31066 raft_consensus.cc:729] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:54.928970 31066 consensus_queue.cc:260] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.929510 31066 ts_tablet_manager.cc:1398] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:54.930404 30303 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-a130bd930dd34683b20eebf600797fee received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:54.930512 30303 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-a130bd930dd34683b20eebf600797fee on tablet a130bd930dd34683b20eebf600797fee with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:54.972411 31066 ts_tablet_manager.cc:902] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:54.974644 31066 tablet_copy_client.cc:308] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.130:38055
I20240502 08:19:54.975276 30379 tablet_copy_service.cc:140] P 04071db453cd4e6db9e0b3f5ad3510dc: Received BeginTabletCopySession request for tablet 7d0b3dae38b54620abb75200b4b421ec from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:38308)
I20240502 08:19:54.975394 30379 tablet_copy_service.cc:161] P 04071db453cd4e6db9e0b3f5ad3510dc: Beginning new tablet copy session on tablet 7d0b3dae38b54620abb75200b4b421ec from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:38308: session id = c86cd001c4794460b702b3d76e8efcab-7d0b3dae38b54620abb75200b4b421ec
I20240502 08:19:54.977757 30379 tablet_copy_source_session.cc:205] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:54.978832 31066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0b3dae38b54620abb75200b4b421ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:54.984354 31066 tablet_copy_client.cc:783] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:54.984555 31066 tablet_copy_client.cc:647] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:54.986783 31066 tablet_copy_client.cc:523] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:54.990469 31066 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:54.995440 31066 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:54.995826 31066 tablet_bootstrap.cc:492] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:54.996081 31066 ts_tablet_manager.cc:1367] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 08:19:54.996767 31066 raft_consensus.cc:348] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.997041 31066 raft_consensus.cc:729] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:54.997218 31066 consensus_queue.cc:260] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:54.997690 31066 ts_tablet_manager.cc:1398] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:54.998390 30379 tablet_copy_service.cc:342] P 04071db453cd4e6db9e0b3f5ad3510dc: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-7d0b3dae38b54620abb75200b4b421ec received from {username='slave'} at 127.0.0.1:38308
I20240502 08:19:54.998497 30379 tablet_copy_service.cc:433] P 04071db453cd4e6db9e0b3f5ad3510dc: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-7d0b3dae38b54620abb75200b4b421ec on tablet 7d0b3dae38b54620abb75200b4b421ec with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:55.059700 31066 ts_tablet_manager.cc:902] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:55.060967 31066 tablet_copy_client.cc:308] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:55.061568 30303 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet 59692a88df104ec2ad428f6b097422ec from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:55.061707 30303 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet 59692a88df104ec2ad428f6b097422ec from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-59692a88df104ec2ad428f6b097422ec
I20240502 08:19:55.064306 30303 tablet_copy_source_session.cc:205] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:55.065622 31066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59692a88df104ec2ad428f6b097422ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:55.071157 31066 tablet_copy_client.cc:783] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:55.071383 31066 tablet_copy_client.cc:647] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:55.073441 31066 tablet_copy_client.cc:523] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:55.076160 31066 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:55.081697 31066 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:55.082101 31066 tablet_bootstrap.cc:492] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:55.082417 31066 ts_tablet_manager.cc:1367] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.006s user 0.008s sys 0.000s
I20240502 08:19:55.083336 31066 raft_consensus.cc:348] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:55.083582 31066 raft_consensus.cc:729] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:55.083793 31066 consensus_queue.cc:260] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:55.084302 31066 ts_tablet_manager.cc:1398] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 08:19:55.084933 30303 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-59692a88df104ec2ad428f6b097422ec received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:55.085047 30303 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-59692a88df104ec2ad428f6b097422ec on tablet 59692a88df104ec2ad428f6b097422ec with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:55.407246 30926 raft_consensus.cc:1203] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:55.486780 30926 raft_consensus.cc:1203] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:55.502957 30926 raft_consensus.cc:1203] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:55.591053 30926 raft_consensus.cc:1203] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:55.924680 31083 raft_consensus.cc:1050] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:55.925423 31083 consensus_queue.cc:237] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:55.928475 30441 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.928544 30926 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.928544 30369 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.928936 31045 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.929155 31082 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.929445 31042 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.932606 31042 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.933548 30441 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.939725 30369 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.940960 30189 catalog_manager.cc:5484] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:55.944901 30927 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.958490 31083 raft_consensus.cc:1050] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:55.960675 31083 consensus_queue.cc:237] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:55.963063 30441 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.963196 30369 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.963600 30927 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.963611 31045 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20240502 08:19:55.964264 31083 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.964486 31042 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.970610 31042 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.970780 30294 consensus_queue.cc:237] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:55.971349 30369 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.974565 30927 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.976063 30190 catalog_manager.cc:5484] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:55.979626 30441 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:55.979810 30927 raft_consensus.cc:1261] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:55.979609 30442 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.980870 31082 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:55.983142 31083 raft_consensus.cc:1050] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:55.983192 31045 consensus_queue.cc:1035] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:55.983945 31083 consensus_queue.cc:237] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:55.984608 31045 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.984805 30294 consensus_queue.cc:237] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:55.989955 30925 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:55.990132 30368 raft_consensus.cc:1261] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:55.990671 31042 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:55.991125 31042 consensus_queue.cc:1035] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:55.994043 31042 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.994956 30926 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:55.997390 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a130bd930dd34683b20eebf600797fee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:55.997442 30368 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.998153 30441 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.998490 31082 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:55.999468 30924 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:55.999591 31045 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:56.000030 30441 raft_consensus.cc:2932] T d51ec2cb58b4422ea5872093467ddd3d P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.000633 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d51ec2cb58b4422ea5872093467ddd3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:56.000556 30369 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.002467 30191 catalog_manager.cc:5484] T d51ec2cb58b4422ea5872093467ddd3d P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.002573 30925 raft_consensus.cc:2932] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.008862 30355 tablet_service.cc:1514] Processing DeleteTablet for tablet d51ec2cb58b4422ea5872093467ddd3d with delete_type TABLET_DATA_TOMBSTONED (TS 04071db453cd4e6db9e0b3f5ad3510dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38270
I20240502 08:19:56.009522 30191 catalog_manager.cc:5484] T a130bd930dd34683b20eebf600797fee P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.010003 31083 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:56.013370 31104 tablet_replica.cc:330] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: stopping tablet replica
I20240502 08:19:56.013388 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet a130bd930dd34683b20eebf600797fee with delete_type TABLET_DATA_TOMBSTONED (TS f40077f920074fffba17e847ebc10339 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53446
I20240502 08:19:56.013581 31104 raft_consensus.cc:2229] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:56.013861 31104 raft_consensus.cc:2258] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:56.014844 31099 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.015460 30368 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.018884 31104 ts_tablet_manager.cc:1875] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:56.018914 30441 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.021662 30191 catalog_manager.cc:5484] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.028273 31104 ts_tablet_manager.cc:1888] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:56.028405 31104 log.cc:1196] T d51ec2cb58b4422ea5872093467ddd3d P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/wals/d51ec2cb58b4422ea5872093467ddd3d
I20240502 08:19:56.029253 30178 catalog_manager.cc:4830] TS 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): tablet d51ec2cb58b4422ea5872093467ddd3d (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:56.037926 31105 tablet_replica.cc:330] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: stopping tablet replica
I20240502 08:19:56.038259 31105 raft_consensus.cc:2229] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:56.038592 31105 raft_consensus.cc:2258] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:56.039933 31105 ts_tablet_manager.cc:1875] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:56.043262 30926 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.054950 31105 ts_tablet_manager.cc:1888] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:56.055122 31105 log.cc:1196] T a130bd930dd34683b20eebf600797fee P f40077f920074fffba17e847ebc10339: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/wals/a130bd930dd34683b20eebf600797fee
I20240502 08:19:56.056718 30291 consensus_queue.cc:237] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:56.058367 30177 catalog_manager.cc:4830] TS f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): tablet a130bd930dd34683b20eebf600797fee (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:56.058712 30926 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:56.058990 30368 raft_consensus.cc:1261] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:56.059280 31099 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:56.060196 31099 consensus_queue.cc:1035] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:56.061630 31083 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.062150 30926 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.064723 30368 raft_consensus.cc:2932] T 59692a88df104ec2ad428f6b097422ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.065662 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 59692a88df104ec2ad428f6b097422ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:56.067325 30190 catalog_manager.cc:5484] T 59692a88df104ec2ad428f6b097422ec P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.073699 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 59692a88df104ec2ad428f6b097422ec with delete_type TABLET_DATA_TOMBSTONED (TS f40077f920074fffba17e847ebc10339 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53446
I20240502 08:19:56.073973 31105 tablet_replica.cc:330] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: stopping tablet replica
I20240502 08:19:56.074164 31105 raft_consensus.cc:2229] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:56.074390 31105 raft_consensus.cc:2258] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:56.075131 31105 ts_tablet_manager.cc:1875] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:56.080130 31105 ts_tablet_manager.cc:1888] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:56.080240 31105 log.cc:1196] T 59692a88df104ec2ad428f6b097422ec P f40077f920074fffba17e847ebc10339: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/wals/59692a88df104ec2ad428f6b097422ec
I20240502 08:19:56.080981 30177 catalog_manager.cc:4830] TS f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): tablet 59692a88df104ec2ad428f6b097422ec (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:56.094974 31011 raft_consensus.cc:1050] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:56.095681 31011 consensus_queue.cc:237] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:56.099390 30294 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:56.099745 30926 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:56.099793 30442 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:56.100172 31108 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:56.100737 31011 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:56.101013 31085 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:56.113920 31085 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.114593 30926 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.115453 30291 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.118906 30442 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.120580 30191 catalog_manager.cc:5484] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.128659 30369 consensus_queue.cc:237] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:56.130062 30926 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:56.130184 30442 raft_consensus.cc:1261] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:56.130517 31085 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:56.130745 31108 consensus_queue.cc:1035] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:56.133323 31109 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.134404 30442 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.134568 30926 raft_consensus.cc:2932] T 7d0b3dae38b54620abb75200b4b421ec P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:56.136821 30178 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7d0b3dae38b54620abb75200b4b421ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:56.139691 30190 catalog_manager.cc:5484] T 7d0b3dae38b54620abb75200b4b421ec P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:56.143185 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0b3dae38b54620abb75200b4b421ec with delete_type TABLET_DATA_TOMBSTONED (TS 04e8e9c9d7b141e6a7c8f76490ec0c1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57230
I20240502 08:19:56.143926 31113 tablet_replica.cc:330] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: stopping tablet replica
I20240502 08:19:56.144134 31113 raft_consensus.cc:2229] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:56.144436 31113 raft_consensus.cc:2258] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:56.145619 31113 ts_tablet_manager.cc:1875] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:56.150027 31113 ts_tablet_manager.cc:1888] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:56.150146 31113 log.cc:1196] T 7d0b3dae38b54620abb75200b4b421ec P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/wals/7d0b3dae38b54620abb75200b4b421ec
I20240502 08:19:56.150775 30176 catalog_manager.cc:4830] TS 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): tablet 7d0b3dae38b54620abb75200b4b421ec (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:57.157449 30291 consensus_queue.cc:237] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.160202 30441 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:57.160606 30260 consensus_peers.cc:485] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff8e4936b3de44e4a7be94c80ae260e2. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:57.160940 31099 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.163259 30369 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.163736 31116 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.163691 31099 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.164220 30442 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.166656 30369 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.170207 30192 catalog_manager.cc:5484] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:57.170585 30291 consensus_queue.cc:237] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.172869 30369 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.172948 30442 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:57.173136 30260 consensus_peers.cc:485] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82ae42e94e344ecfaaed26222ccc9b86. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:57.173372 31116 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.173687 31117 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.179867 31099 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.180469 30369 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.186718 30369 consensus_queue.cc:237] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.187613 30190 catalog_manager.cc:5484] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.189046 30291 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.189551 31085 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.189663 30441 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
W20240502 08:19:57.191028 30335 consensus_peers.cc:485] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9db55398254b48d6a96623ea9d563561. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:57.191273 30442 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.192103 31108 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.193265 31085 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.195080 30441 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.195757 30291 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.200496 30369 consensus_queue.cc:237] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.204838 30291 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.206598 30441 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:57.208195 31085 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20240502 08:19:57.208717 31085 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:57.208796 30192 catalog_manager.cc:5484] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
W20240502 08:19:57.209667 30335 consensus_peers.cc:485] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82577cbf65394ea1b821117762f25b58. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:57.216480 31130 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.217341 30291 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.220044 30441 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.224658 30189 catalog_manager.cc:5484] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:57.595110 31136 ts_tablet_manager.cc:902] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:57.596503 31136 tablet_copy_client.cc:308] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:57.597131 30303 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet 82ae42e94e344ecfaaed26222ccc9b86 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:57.597247 30303 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet 82ae42e94e344ecfaaed26222ccc9b86 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-82ae42e94e344ecfaaed26222ccc9b86
I20240502 08:19:57.599716 30303 tablet_copy_source_session.cc:205] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:57.600832 31136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ae42e94e344ecfaaed26222ccc9b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:57.606500 31136 tablet_copy_client.cc:783] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:57.606735 31136 tablet_copy_client.cc:647] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:57.608132 31136 tablet_copy_client.cc:523] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:57.610147 31136 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:57.614837 31136 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:57.615162 31136 tablet_bootstrap.cc:492] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:57.615406 31136 ts_tablet_manager.cc:1367] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.005s user 0.006s sys 0.000s
I20240502 08:19:57.616084 31136 raft_consensus.cc:348] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.616248 31136 raft_consensus.cc:729] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:57.616442 31136 consensus_queue.cc:260] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.617271 31136 ts_tablet_manager.cc:1398] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 08:19:57.617978 30303 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-82ae42e94e344ecfaaed26222ccc9b86 received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:57.618062 30303 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-82ae42e94e344ecfaaed26222ccc9b86 on tablet 82ae42e94e344ecfaaed26222ccc9b86 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:57.658466 31136 ts_tablet_manager.cc:902] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
I20240502 08:19:57.659736 31136 tablet_copy_client.cc:308] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.129:35355
I20240502 08:19:57.660303 30303 tablet_copy_service.cc:140] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Received BeginTabletCopySession request for tablet ff8e4936b3de44e4a7be94c80ae260e2 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:57266)
I20240502 08:19:57.660450 30303 tablet_copy_service.cc:161] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Beginning new tablet copy session on tablet ff8e4936b3de44e4a7be94c80ae260e2 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:57266: session id = c86cd001c4794460b702b3d76e8efcab-ff8e4936b3de44e4a7be94c80ae260e2
I20240502 08:19:57.662782 30303 tablet_copy_source_session.cc:205] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:57.663908 31136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff8e4936b3de44e4a7be94c80ae260e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:57.669382 31136 tablet_copy_client.cc:783] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:57.669677 31136 tablet_copy_client.cc:647] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:57.670879 31136 tablet_copy_client.cc:523] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:57.673576 31136 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:57.679026 31136 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:57.679320 31136 tablet_bootstrap.cc:492] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:57.679514 31136 ts_tablet_manager.cc:1367] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 08:19:57.680114 31136 raft_consensus.cc:348] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.680303 31136 raft_consensus.cc:729] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:57.680454 31136 consensus_queue.cc:260] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.680868 31136 ts_tablet_manager.cc:1398] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 08:19:57.681464 30303 tablet_copy_service.cc:342] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-ff8e4936b3de44e4a7be94c80ae260e2 received from {username='slave'} at 127.0.0.1:57266
I20240502 08:19:57.681574 30303 tablet_copy_service.cc:433] P 04e8e9c9d7b141e6a7c8f76490ec0c1a: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-ff8e4936b3de44e4a7be94c80ae260e2 on tablet ff8e4936b3de44e4a7be94c80ae260e2 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:57.754259 31136 ts_tablet_manager.cc:902] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:57.763365 31136 tablet_copy_client.cc:308] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.130:38055
I20240502 08:19:57.764112 30379 tablet_copy_service.cc:140] P 04071db453cd4e6db9e0b3f5ad3510dc: Received BeginTabletCopySession request for tablet 82577cbf65394ea1b821117762f25b58 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:38308)
I20240502 08:19:57.764271 30379 tablet_copy_service.cc:161] P 04071db453cd4e6db9e0b3f5ad3510dc: Beginning new tablet copy session on tablet 82577cbf65394ea1b821117762f25b58 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:38308: session id = c86cd001c4794460b702b3d76e8efcab-82577cbf65394ea1b821117762f25b58
I20240502 08:19:57.766520 31152 ts_tablet_manager.cc:902] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055)
I20240502 08:19:57.766784 30379 tablet_copy_source_session.cc:205] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:57.768051 31136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82577cbf65394ea1b821117762f25b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:57.773475 31136 tablet_copy_client.cc:783] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:57.773855 31136 tablet_copy_client.cc:647] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:57.774976 31152 tablet_copy_client.cc:308] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Beginning tablet copy session from remote peer at address 127.28.130.130:38055
I20240502 08:19:57.775830 30379 tablet_copy_service.cc:140] P 04071db453cd4e6db9e0b3f5ad3510dc: Received BeginTabletCopySession request for tablet 9db55398254b48d6a96623ea9d563561 from peer c86cd001c4794460b702b3d76e8efcab ({username='slave'} at 127.0.0.1:38308)
I20240502 08:19:57.775856 31136 tablet_copy_client.cc:523] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:57.775975 30379 tablet_copy_service.cc:161] P 04071db453cd4e6db9e0b3f5ad3510dc: Beginning new tablet copy session on tablet 9db55398254b48d6a96623ea9d563561 from peer c86cd001c4794460b702b3d76e8efcab at {username='slave'} at 127.0.0.1:38308: session id = c86cd001c4794460b702b3d76e8efcab-9db55398254b48d6a96623ea9d563561
I20240502 08:19:57.778184 30379 tablet_copy_source_session.cc:205] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 08:19:57.778596 31136 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:57.779109 31152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db55398254b48d6a96623ea9d563561. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:19:57.784520 31152 tablet_copy_client.cc:783] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 0 data blocks...
I20240502 08:19:57.784770 31152 tablet_copy_client.cc:647] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Starting download of 1 WAL segments...
I20240502 08:19:57.785079 31136 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:57.785405 31136 tablet_bootstrap.cc:492] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:57.785640 31136 ts_tablet_manager.cc:1367] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20240502 08:19:57.786123 31136 raft_consensus.cc:348] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.786628 31136 raft_consensus.cc:729] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:57.786876 31136 consensus_queue.cc:260] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.787535 31136 ts_tablet_manager.cc:1398] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 08:19:57.788156 30379 tablet_copy_service.cc:342] P 04071db453cd4e6db9e0b3f5ad3510dc: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-82577cbf65394ea1b821117762f25b58 received from {username='slave'} at 127.0.0.1:38308
I20240502 08:19:57.788285 30379 tablet_copy_service.cc:433] P 04071db453cd4e6db9e0b3f5ad3510dc: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-82577cbf65394ea1b821117762f25b58 on tablet 82577cbf65394ea1b821117762f25b58 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:57.789248 31152 tablet_copy_client.cc:523] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 08:19:57.792395 31152 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Bootstrap starting.
I20240502 08:19:57.796628 31152 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 08:19:57.796965 31152 tablet_bootstrap.cc:492] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Bootstrap complete.
I20240502 08:19:57.797185 31152 ts_tablet_manager.cc:1367] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 08:19:57.797717 31152 raft_consensus.cc:348] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.797921 31152 raft_consensus.cc:729] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c86cd001c4794460b702b3d76e8efcab, State: Initialized, Role: LEARNER
I20240502 08:19:57.798097 31152 consensus_queue.cc:260] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:57.798604 31152 ts_tablet_manager.cc:1398] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 08:19:57.799125 30379 tablet_copy_service.cc:342] P 04071db453cd4e6db9e0b3f5ad3510dc: Request end of tablet copy session c86cd001c4794460b702b3d76e8efcab-9db55398254b48d6a96623ea9d563561 received from {username='slave'} at 127.0.0.1:38308
I20240502 08:19:57.799238 30379 tablet_copy_service.cc:433] P 04071db453cd4e6db9e0b3f5ad3510dc: ending tablet copy session c86cd001c4794460b702b3d76e8efcab-9db55398254b48d6a96623ea9d563561 on tablet 9db55398254b48d6a96623ea9d563561 with peer c86cd001c4794460b702b3d76e8efcab
I20240502 08:19:58.119333 30926 raft_consensus.cc:1203] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:58.152575 30926 raft_consensus.cc:1203] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:58.188759 30926 raft_consensus.cc:1203] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:58.287197 30926 raft_consensus.cc:1203] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 08:19:58.558257 31116 raft_consensus.cc:1050] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:58.559027 31116 consensus_queue.cc:237] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.561445 30368 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.561430 30441 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.561434 30926 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.562055 31163 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.562420 31116 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.562902 31117 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.573674 30369 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.574067 30926 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.573094 31116 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.579540 30189 catalog_manager.cc:5484] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.583755 30441 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.597959 31132 raft_consensus.cc:1050] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:58.597970 30291 consensus_queue.cc:237] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.598798 31132 consensus_queue.cc:237] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.599866 30441 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.600342 31116 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.600641 30926 raft_consensus.cc:1261] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.601140 31116 consensus_queue.cc:1035] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.603073 31083 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.603942 30926 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.604036 30442 raft_consensus.cc:2932] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.609414 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ff8e4936b3de44e4a7be94c80ae260e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:58.610384 30192 catalog_manager.cc:5484] T ff8e4936b3de44e4a7be94c80ae260e2 P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.615288 30355 tablet_service.cc:1514] Processing DeleteTablet for tablet ff8e4936b3de44e4a7be94c80ae260e2 with delete_type TABLET_DATA_TOMBSTONED (TS 04071db453cd4e6db9e0b3f5ad3510dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38270
I20240502 08:19:58.616044 31172 tablet_replica.cc:330] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: stopping tablet replica
I20240502 08:19:58.616288 31172 raft_consensus.cc:2229] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:58.616647 31172 raft_consensus.cc:2258] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:58.618594 31172 ts_tablet_manager.cc:1875] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:58.619513 30926 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.619992 31160 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.620859 30441 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.622291 30291 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.622754 31132 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.623387 31160 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.628021 31172 ts_tablet_manager.cc:1888] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:58.628122 31172 log.cc:1196] T ff8e4936b3de44e4a7be94c80ae260e2 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/wals/ff8e4936b3de44e4a7be94c80ae260e2
I20240502 08:19:58.629407 30178 catalog_manager.cc:4830] TS 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): tablet ff8e4936b3de44e4a7be94c80ae260e2 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:58.630646 31160 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.632596 30441 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.635843 30926 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.636592 30294 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.639288 30191 catalog_manager.cc:5484] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.645699 30367 consensus_queue.cc:237] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.647352 30926 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.647850 31160 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.649510 30441 raft_consensus.cc:1261] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.649735 31130 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.650036 31132 consensus_queue.cc:1035] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.651316 30441 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.653100 30178 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 82577cbf65394ea1b821117762f25b58 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:58.653426 30926 raft_consensus.cc:2932] T 82577cbf65394ea1b821117762f25b58 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.654984 30191 catalog_manager.cc:5484] T 82577cbf65394ea1b821117762f25b58 P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index 3 to 4, VOTER 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129) evicted. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 08:19:58.661737 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet 82577cbf65394ea1b821117762f25b58 with delete_type TABLET_DATA_TOMBSTONED (TS 04e8e9c9d7b141e6a7c8f76490ec0c1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57230
I20240502 08:19:58.662647 31177 tablet_replica.cc:330] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: stopping tablet replica
I20240502 08:19:58.662855 31177 raft_consensus.cc:2229] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:58.663332 31177 raft_consensus.cc:2258] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:58.664304 31177 ts_tablet_manager.cc:1875] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:58.664731 31083 raft_consensus.cc:1050] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:58.665347 31083 consensus_queue.cc:237] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.667199 30926 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.667260 30441 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.667723 31117 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.668236 31163 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.668825 30368 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.669732 31177 ts_tablet_manager.cc:1888] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:58.669894 31177 log.cc:1196] T 82577cbf65394ea1b821117762f25b58 P 04e8e9c9d7b141e6a7c8f76490ec0c1a: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-0-root/wals/82577cbf65394ea1b821117762f25b58
I20240502 08:19:58.670341 31163 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.670997 30176 catalog_manager.cc:4830] TS 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355): tablet 82577cbf65394ea1b821117762f25b58 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:58.673238 31163 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.673707 30926 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.674393 30442 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.678193 30368 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.679250 30190 catalog_manager.cc:5484] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.685148 30294 consensus_queue.cc:237] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.686997 30442 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.687283 30926 raft_consensus.cc:1261] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.687484 31083 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.688344 31083 consensus_queue.cc:1035] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.690434 31116 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.691174 30925 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.693320 30176 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 82ae42e94e344ecfaaed26222ccc9b86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:58.694998 30442 raft_consensus.cc:2932] T 82ae42e94e344ecfaaed26222ccc9b86 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.695369 30192 catalog_manager.cc:5484] T 82ae42e94e344ecfaaed26222ccc9b86 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130) evicted. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.699399 30355 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ae42e94e344ecfaaed26222ccc9b86 with delete_type TABLET_DATA_TOMBSTONED (TS 04071db453cd4e6db9e0b3f5ad3510dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38270
I20240502 08:19:58.699676 31172 tablet_replica.cc:330] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: stopping tablet replica
I20240502 08:19:58.699888 31172 raft_consensus.cc:2229] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:58.700119 31172 raft_consensus.cc:2258] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:58.702301 31172 ts_tablet_manager.cc:1875] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:58.707767 31132 raft_consensus.cc:1050] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc: attempting to promote NON_VOTER c86cd001c4794460b702b3d76e8efcab to VOTER
I20240502 08:19:58.707952 31172 ts_tablet_manager.cc:1888] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:58.708050 31172 log.cc:1196] T 82ae42e94e344ecfaaed26222ccc9b86 P 04071db453cd4e6db9e0b3f5ad3510dc: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-1-root/wals/82ae42e94e344ecfaaed26222ccc9b86
I20240502 08:19:58.708653 31132 consensus_queue.cc:237] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.710117 30178 catalog_manager.cc:4830] TS 04071db453cd4e6db9e0b3f5ad3510dc (127.28.130.130:38055): tablet 82ae42e94e344ecfaaed26222ccc9b86 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:58.711014 30925 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 LEARNER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.711020 30442 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.711512 31130 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.711681 30294 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 08:19:58.712117 31130 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 08:19:58.714320 31130 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20240502 08:19:58.717010 31176 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.717643 30294 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.719393 30442 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.723955 30192 catalog_manager.cc:5484] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.725232 30925 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c86cd001c4794460b702b3d76e8efcab (127.28.130.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.728765 30367 consensus_queue.cc:237] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } }
I20240502 08:19:58.730432 30294 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.730540 30925 raft_consensus.cc:1261] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 08:19:58.731038 31176 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.733002 31176 consensus_queue.cc:1035] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 08:19:58.733409 31160 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.734524 30925 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.736482 30178 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9db55398254b48d6a96623ea9d563561 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 08:19:58.738066 30294 raft_consensus.cc:2932] T 9db55398254b48d6a96623ea9d563561 P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.739182 30191 catalog_manager.cc:5484] T 9db55398254b48d6a96623ea9d563561 P c86cd001c4794460b702b3d76e8efcab reported cstate change: config changed from index 3 to 4, VOTER f40077f920074fffba17e847ebc10339 (127.28.130.131) evicted. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: false } } }
I20240502 08:19:58.744025 30425 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db55398254b48d6a96623ea9d563561 with delete_type TABLET_DATA_TOMBSTONED (TS f40077f920074fffba17e847ebc10339 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53446
I20240502 08:19:58.750782 31186 tablet_replica.cc:330] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: stopping tablet replica
I20240502 08:19:58.750995 31186 raft_consensus.cc:2229] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 08:19:58.751230 31186 raft_consensus.cc:2258] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 08:19:58.751850 31186 ts_tablet_manager.cc:1875] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 08:19:58.756361 31186 ts_tablet_manager.cc:1888] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 08:19:58.756479 31186 log.cc:1196] T 9db55398254b48d6a96623ea9d563561 P f40077f920074fffba17e847ebc10339: Deleting WAL directory at /tmp/dist-test-taskZnLRgY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714637931256210-29194-0/minicluster-data/ts-2-root/wals/9db55398254b48d6a96623ea9d563561
I20240502 08:19:58.757154 30177 catalog_manager.cc:4830] TS f40077f920074fffba17e847ebc10339 (127.28.130.131:34581): tablet 9db55398254b48d6a96623ea9d563561 (table test-workload [id=fd4e17b37cbb476384dc838c6f47b563]) successfully deleted
I20240502 08:19:59.755887 30294 consensus_queue.cc:237] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:59.757889 30368 raft_consensus.cc:1261] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.757922 30441 raft_consensus.cc:1261] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:59.758417 30260 consensus_peers.cc:485] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c3667036991403bab82f9f76c36b65b. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:59.758540 31188 consensus_queue.cc:1035] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.758759 31116 consensus_queue.cc:1035] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.760879 31188 raft_consensus.cc:2932] T 7c3667036991403bab82f9f76c36b65b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.761507 30368 raft_consensus.cc:2932] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.761469 30441 raft_consensus.cc:2932] T 7c3667036991403bab82f9f76c36b65b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.766088 30191 catalog_manager.cc:5484] T 7c3667036991403bab82f9f76c36b65b P 04071db453cd4e6db9e0b3f5ad3510dc reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.768493 30368 consensus_queue.cc:237] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:59.772159 30294 raft_consensus.cc:1261] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.772635 31176 consensus_queue.cc:1035] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.773061 30441 raft_consensus.cc:1261] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04071db453cd4e6db9e0b3f5ad3510dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 08:19:59.773133 30335 consensus_peers.cc:485] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 462907f615aa4a789ccac135ab693fdd. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:59.773470 31176 consensus_queue.cc:1035] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.775867 31132 raft_consensus.cc:2932] T 462907f615aa4a789ccac135ab693fdd P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.776523 30441 raft_consensus.cc:2932] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.780136 30294 consensus_queue.cc:237] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
W20240502 08:19:59.782644 30260 consensus_peers.cc:485] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 756a969437e74599a39cc9c2c38c7e9c. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:59.784786 30368 raft_consensus.cc:1261] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.785377 30190 catalog_manager.cc:5484] T 462907f615aa4a789ccac135ab693fdd P f40077f920074fffba17e847ebc10339 reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.785392 31188 consensus_queue.cc:1035] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.788117 31116 raft_consensus.cc:2932] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.788743 30368 raft_consensus.cc:2932] T 756a969437e74599a39cc9c2c38c7e9c P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.787990 30441 raft_consensus.cc:1261] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.794708 30294 consensus_queue.cc:237] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } }
I20240502 08:19:59.795118 30190 catalog_manager.cc:5484] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:59.793715 31116 consensus_queue.cc:1035] T 756a969437e74599a39cc9c2c38c7e9c P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20240502 08:19:59.798226 30260 consensus_peers.cc:485] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a -> Peer c86cd001c4794460b702b3d76e8efcab (127.28.130.132:46425): Couldn't send request to peer c86cd001c4794460b702b3d76e8efcab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbd976cd2d74411997117f936069dd1b. This is attempt 1: this message will repeat every 5th retry.
I20240502 08:19:59.798345 30368 raft_consensus.cc:1261] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.798939 30441 raft_consensus.cc:1261] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Refusing update from remote peer 04e8e9c9d7b141e6a7c8f76490ec0c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 08:19:59.798847 30442 raft_consensus.cc:2932] T 756a969437e74599a39cc9c2c38c7e9c P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } attrs { replace: true } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.799400 31116 consensus_queue.cc:1035] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.801769 31116 consensus_queue.cc:1035] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 08:19:59.802685 30294 raft_consensus.cc:2932] T 462907f615aa4a789ccac135ab693fdd P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } attrs { replace: true } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.803992 31116 raft_consensus.cc:2932] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.809955 30368 raft_consensus.cc:2932] T fbd976cd2d74411997117f936069dd1b P 04071db453cd4e6db9e0b3f5ad3510dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:19:59.812311 30192 catalog_manager.cc:5484] T fbd976cd2d74411997117f936069dd1b P 04e8e9c9d7b141e6a7c8f76490ec0c1a reported cstate change: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New cstate: current_term: 1 leader_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 08:19:59.818962 30441 raft_consensus.cc:2932] T fbd976cd2d74411997117f936069dd1b P f40077f920074fffba17e847ebc10339 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c86cd001c4794460b702b3d76e8efcab (127.28.130.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e8e9c9d7b141e6a7c8f76490ec0c1a" member_type: VOTER last_known_addr { host: "127.28.130.129" port: 35355 } } peers { permanent_uuid: "04071db453cd4e6db9e0b3f5ad3510dc" member_type: VOTER last_known_addr { host: "127.28.130.130" port: 38055 } attrs { replace: true } } peers { permanent_uuid: "f40077f920074fffba17e847ebc10339" member_type: VOTER last_known_addr { host: "127.28.130.131" port: 34581 } } peers { permanent_uuid: "c86cd001c4794460b702b3d76e8efcab" member_type: NON_VOTER last_known_addr { host: "127.28.130.132" port: 46425 } attrs { promote: true } } }
I20240502 08:20:00.238098 31207 ts_tablet_manager.cc:902] T 7c3667036991403bab82f9f76c36b65b P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
F20240502 08:20:00.239017 31207 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-1b52ae043b824aea9065625ac834ce22.queue_time_us, tablet-download-pool-1b52ae043b824aea9065625ac834ce22.queue_time_us) (tablet-download-pool-1b52ae043b824aea9065625ac834ce22.run_cpu_time_us, tablet-download-pool-1b52ae043b824aea9065625ac834ce22.run_cpu_time_us) (tablet-download-pool-1b52ae043b824aea9065625ac834ce22.run_wall_time_us, tablet-download-pool-1b52ae043b824aea9065625ac834ce22.run_wall_time_us) (tablet-download-pool-3bee358532964d899a5a3d6494b391e2.queue_time_us, tablet-download-pool-3bee358532964d899a5a3d6494b391e2.queue_time_us) (tablet-download-pool-3bee358532964d899a5a3d6494b391e2.run_cpu_time_us, tablet-download-pool-3bee358532964d899a5a3d6494b391e2.run_cpu_time_us) (tablet-download-pool-3bee358532964d899a5a3d6494b391e2.run_wall_time_us, tablet-download-pool-3bee358532964d899a5a3d6494b391e2.run_wall_time_us) (tablet-download-pool-59692a88df104ec2ad428f6b097422ec.queue_time_us, tablet-download-pool-59692a88df104ec2ad428f6b097422ec.queue_time_us) (tablet-download-pool-59692a88df104ec2ad428f6b097422ec.run_cpu_time_us, tablet-download-pool-59692a88df104ec2ad428f6b097422ec.run_cpu_time_us) (tablet-download-pool-59692a88df104ec2ad428f6b097422ec.run_wall_time_us, tablet-download-pool-59692a88df104ec2ad428f6b097422ec.run_wall_time_us) (tablet-download-pool-7c3667036991403bab82f9f76c36b65b.queue_time_us, tablet-download-pool-7c3667036991403bab82f9f76c36b65b.queue_time_us) (tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.queue_time_us, tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.queue_time_us) (tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.run_cpu_time_us, tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.run_cpu_time_us) (tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.run_wall_time_us, tablet-download-pool-7d0b3dae38b54620abb75200b4b421ec.run_wall_time_us) (tablet-download-pool-82577cbf65394ea1b821117762f25b58.queue_time_us, tablet-download-pool-82577cbf65394ea1b821117762f25b58.queue_time_us) (tablet-download-pool-82577cbf65394ea1b821117762f25b58.run_cpu_time_us, tablet-download-pool-82577cbf65394ea1b821117762f25b58.run_cpu_time_us) (tablet-download-pool-82577cbf65394ea1b821117762f25b58.run_wall_time_us, tablet-download-pool-82577cbf65394ea1b821117762f25b58.run_wall_time_us) (tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.queue_time_us, tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.queue_time_us) (tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.run_cpu_time_us, tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.run_cpu_time_us) (tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.run_wall_time_us, tablet-download-pool-82ae42e94e344ecfaaed26222ccc9b86.run_wall_time_us) (tablet-download-pool-9db55398254b48d6a96623ea9d563561.queue_time_us, tablet-download-pool-9db55398254b48d6a96623ea9d563561.queue_time_us) (tablet-download-pool-9db55398254b48d6a96623ea9d563561.run_cpu_time_us, tablet-download-pool-9db55398254b48d6a96623ea9d563561.run_cpu_time_us) (tablet-download-pool-9db55398254b48d6a96623ea9d563561.run_wall_time_us, tablet-download-pool-9db55398254b48d6a96623ea9d563561.run_wall_time_us) (tablet-download-pool-9e636180fea54536809d2981178098d8.queue_time_us, tablet-download-pool-9e636180fea54536809d2981178098d8.queue_time_us) (tablet-download-pool-9e636180fea54536809d2981178098d8.run_cpu_time_us, tablet-download-pool-9e636180fea54536809d2981178098d8.run_cpu_time_us) (tablet-download-pool-9e636180fea54536809d2981178098d8.run_wall_time_us, tablet-download-pool-9e636180fea54536809d2981178098d8.run_wall_time_us) (tablet-download-pool-a130bd930dd34683b20eebf600797fee.queue_time_us, tablet-download-pool-a130bd930dd34683b20eebf600797fee.queue_time_us) (tablet-download-pool-a130bd930dd34683b20eebf600797fee.run_cpu_time_us, tablet-download-pool-a130bd930dd34683b20eebf600797fee.run_cpu_time_us) (tablet-download-pool-a130bd930dd34683b20eebf600797fee.run_wall_time_us, tablet-download-pool-a130bd930dd34683b20eebf600797fee.run_wall_time_us) (tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.queue_time_us, tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.queue_time_us) (tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.run_cpu_time_us, tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.run_cpu_time_us) (tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.run_wall_time_us, tablet-download-pool-d1c63644a39642eeae800e736bdfebe3.run_wall_time_us) (tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.queue_time_us, tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.queue_time_us) (tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.run_cpu_time_us, tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.run_cpu_time_us) (tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.run_wall_time_us, tablet-download-pool-d51ec2cb58b4422ea5872093467ddd3d.run_wall_time_us) (tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.queue_time_us, tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.queue_time_us) (tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.run_cpu_time_us, tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.run_cpu_time_us) (tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.run_wall_time_us, tablet-download-pool-ff8e4936b3de44e4a7be94c80ae260e2.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714638000 (unix time) try "date -d @1714638000" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000720a) received by PID 29194 (TID 0x7f401b8ad700) from PID 29194; stack trace: ***
@ 0x7f40d3423980 (unknown) at ??:0
@ 0x7f40c8770fb7 gsignal at ??:0
@ 0x7f40c8772921 abort at ??:0
@ 0x7f40cb225dcd google::LogMessage::Fail() at ??:0
@ 0x7f40cb229b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f40cb2257cc google::LogMessage::Flush() at ??:0
@ 0x7f40cb226f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f40cc8a2742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f40cc86ef8b kudu::ThreadPool::ThreadPool() at ??:0
I20240502 08:20:00.280246 31215 ts_tablet_manager.cc:902] T 756a969437e74599a39cc9c2c38c7e9c P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
@ 0x7f40cc868cd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f40dbd348de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f40dbd4cdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f40dbe77480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f40dbeafa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f40dbe92981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f40dbe9270e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f40e0d3498d std::function<>::operator()() at ??:0
@ 0x7f40cc872b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f40cc87619c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f40cc876019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f40e0d3498d std::function<>::operator()() at ??:0
I20240502 08:20:00.351644 31229 ts_tablet_manager.cc:902] T fbd976cd2d74411997117f936069dd1b P c86cd001c4794460b702b3d76e8efcab: Initiating tablet copy from peer 04e8e9c9d7b141e6a7c8f76490ec0c1a (127.28.130.129:35355)
@ 0x7f40cc85101e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f40d34186db start_thread at ??:0
@ 0x7f40c885371f clone at ??:0