[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 14:01:27.354414 4154 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.14.190:35093
I20240501 14:01:27.356199 4154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:01:27.357580 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:27.369585 4160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.370105 4159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.370621 4162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.371201 4154 server_base.cc:1034] running on GCE node
I20240501 14:01:27.372201 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:27.372390 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:27.372540 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572087372457 us; error 0 us; skew 500 ppm
I20240501 14:01:27.372972 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:27.375979 4154 webserver.cc:460] Webserver started at http://127.4.14.190:40085/ using document root <none> and password file <none>
I20240501 14:01:27.376852 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:27.376965 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:27.377336 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:27.380990 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/master-0-root/instance:
uuid: "7f307938bb8d49d790a76c2372c593d5"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.387815 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20240501 14:01:27.391530 4167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.393254 4154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:01:27.393492 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/master-0-root
uuid: "7f307938bb8d49d790a76c2372c593d5"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.393698 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:27.423923 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:27.425117 4154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:01:27.425449 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:27.443790 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.190:35093
I20240501 14:01:27.443794 4218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.190:35093 every 8 connection(s)
I20240501 14:01:27.448701 4219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.462594 4219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: Bootstrap starting.
I20240501 14:01:27.466876 4219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:27.468264 4219 log.cc:824] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: Log is configured to *not* fsync() on all Append() calls
I20240501 14:01:27.471276 4219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: No bootstrap required, opened a new log
I20240501 14:01:27.479036 4219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER }
I20240501 14:01:27.479466 4219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:27.479597 4219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f307938bb8d49d790a76c2372c593d5, State: Initialized, Role: FOLLOWER
I20240501 14:01:27.480468 4219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER }
I20240501 14:01:27.480716 4219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:01:27.480855 4219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:01:27.481038 4219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:27.483626 4219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER }
I20240501 14:01:27.484274 4219 leader_election.cc:302] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f307938bb8d49d790a76c2372c593d5; no voters:
I20240501 14:01:27.484972 4219 leader_election.cc:288] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:01:27.485128 4222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:27.485807 4222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 1 LEADER]: Becoming Leader. State: Replica: 7f307938bb8d49d790a76c2372c593d5, State: Running, Role: LEADER
I20240501 14:01:27.486470 4222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER }
I20240501 14:01:27.487192 4219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:01:27.489519 4224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f307938bb8d49d790a76c2372c593d5. Latest consensus state: current_term: 1 leader_uuid: "7f307938bb8d49d790a76c2372c593d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER } }
I20240501 14:01:27.489558 4223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f307938bb8d49d790a76c2372c593d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f307938bb8d49d790a76c2372c593d5" member_type: VOTER } }
I20240501 14:01:27.489904 4223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [sys.catalog]: This master's current role is: LEADER
I20240501 14:01:27.490497 4224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [sys.catalog]: This master's current role is: LEADER
I20240501 14:01:27.490877 4230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:01:27.497895 4230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:01:27.498582 4154 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 14:01:27.509217 4230 catalog_manager.cc:1347] Generated new cluster ID: 5e015820408741aca09a60028e60d5fd
I20240501 14:01:27.509359 4230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:01:27.524791 4230 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:01:27.526181 4230 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:01:27.540632 4230 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: Generated new TSK 0
I20240501 14:01:27.542229 4230 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:01:27.564953 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:27.569839 4241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.570762 4242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.571138 4244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.571889 4154 server_base.cc:1034] running on GCE node
I20240501 14:01:27.572248 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:27.572350 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:27.572417 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572087572393 us; error 0 us; skew 500 ppm
I20240501 14:01:27.572623 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:27.574132 4154 webserver.cc:460] Webserver started at http://127.4.14.129:41469/ using document root <none> and password file <none>
I20240501 14:01:27.574399 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:27.574488 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:27.574659 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:27.575407 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-0-root/instance:
uuid: "9804f6169505461c805cdc65dec8e41a"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.578459 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240501 14:01:27.580564 4249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.581040 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 14:01:27.581171 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
uuid: "9804f6169505461c805cdc65dec8e41a"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.581315 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:27.595146 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:27.595942 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:27.596973 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:27.598595 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:27.598714 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.598857 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:27.598950 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.618949 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.129:34339
I20240501 14:01:27.618969 4311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.129:34339 every 8 connection(s)
I20240501 14:01:27.621196 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:27.630635 4314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.631886 4315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.638005 4154 server_base.cc:1034] running on GCE node
W20240501 14:01:27.641597 4320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.642241 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:27.642342 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:27.642438 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572087642396 us; error 0 us; skew 500 ppm
I20240501 14:01:27.642613 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:27.644225 4154 webserver.cc:460] Webserver started at http://127.4.14.130:35033/ using document root <none> and password file <none>
I20240501 14:01:27.644501 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:27.644644 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:27.644805 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:27.645704 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-1-root/instance:
uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.652014 4312 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35093
I20240501 14:01:27.652485 4312 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:27.653594 4312 heartbeater.cc:511] Master 127.4.14.190:35093 requested a full tablet report, sending...
I20240501 14:01:27.655330 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.007s
I20240501 14:01:27.656565 4184 ts_manager.cc:194] Registered new tserver with Master: 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339)
I20240501 14:01:27.657548 4324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.657976 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 14:01:27.658114 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.658277 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:27.659269 4184 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58264
I20240501 14:01:27.683889 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:27.684677 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:27.685377 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:27.686426 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:27.686506 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.686618 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:27.686672 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.708248 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.130:46753
I20240501 14:01:27.708284 4386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.130:46753 every 8 connection(s)
I20240501 14:01:27.710132 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:27.714761 4390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:27.715401 4391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.718647 4387 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35093
I20240501 14:01:27.718838 4387 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:27.719460 4387 heartbeater.cc:511] Master 127.4.14.190:35093 requested a full tablet report, sending...
I20240501 14:01:27.720798 4184 ts_manager.cc:194] Registered new tserver with Master: 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:27.721912 4184 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58278
I20240501 14:01:27.722607 4154 server_base.cc:1034] running on GCE node
W20240501 14:01:27.722966 4394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:27.723582 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:27.723709 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:27.723771 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572087723748 us; error 0 us; skew 500 ppm
I20240501 14:01:27.723965 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:27.731142 4154 webserver.cc:460] Webserver started at http://127.4.14.131:36501/ using document root <none> and password file <none>
I20240501 14:01:27.731436 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:27.731539 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:27.731695 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:27.732545 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-2-root/instance:
uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.735167 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 14:01:27.736896 4398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.737260 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20240501 14:01:27.737373 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
format_stamp: "Formatted at 2024-05-01 14:01:27 on dist-test-slave-78f7"
I20240501 14:01:27.737510 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714572087283996-4154-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:27.769922 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:27.770622 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:27.771353 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:27.772439 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:27.772540 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.772650 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:27.772727 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:27.792629 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.131:41493
I20240501 14:01:27.792680 4460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.131:41493 every 8 connection(s)
I20240501 14:01:27.801959 4461 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35093
I20240501 14:01:27.802166 4461 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:27.802812 4461 heartbeater.cc:511] Master 127.4.14.190:35093 requested a full tablet report, sending...
I20240501 14:01:27.803988 4184 ts_manager.cc:194] Registered new tserver with Master: 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:27.804441 4154 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.010477732s
I20240501 14:01:27.805172 4184 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58280
I20240501 14:01:27.806097 4154 test_util.cc:268] Using random seed: -331593619
I20240501 14:01:27.831000 4184 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58288:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 14:01:27.833539 4184 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 14:01:27.883414 4277 tablet_service.cc:1467] Processing CreateTablet for tablet 5667f490d3a340fda405bcad8d32d86c (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 14:01:27.884559 4277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5667f490d3a340fda405bcad8d32d86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.887919 4276 tablet_service.cc:1467] Processing CreateTablet for tablet 37d6068892dc40c0939974b451819ade (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 14:01:27.888624 4276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d6068892dc40c0939974b451819ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.890034 4275 tablet_service.cc:1467] Processing CreateTablet for tablet 2223b1853419470ca3c323d16103d40b (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 14:01:27.890722 4275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223b1853419470ca3c323d16103d40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.890902 4274 tablet_service.cc:1467] Processing CreateTablet for tablet 8398c277e182475eb9d42e97a0a15ca2 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 14:01:27.891407 4274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8398c277e182475eb9d42e97a0a15ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.893152 4272 tablet_service.cc:1467] Processing CreateTablet for tablet ecbb4e1fc48f41dc96598a918ac24025 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 14:01:27.893626 4272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecbb4e1fc48f41dc96598a918ac24025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.894604 4271 tablet_service.cc:1467] Processing CreateTablet for tablet 1ca23eacd4514e81bdf19eef1ecc802f (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 14:01:27.894804 4270 tablet_service.cc:1467] Processing CreateTablet for tablet 6b7511eb5e014c2088d80bf5e71d68a6 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 14:01:27.895164 4271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ca23eacd4514e81bdf19eef1ecc802f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.895440 4270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b7511eb5e014c2088d80bf5e71d68a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.898433 4269 tablet_service.cc:1467] Processing CreateTablet for tablet 48edcd15e8574e8b9a6800e22f1a55e0 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 14:01:27.901635 4269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48edcd15e8574e8b9a6800e22f1a55e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.901710 4273 tablet_service.cc:1467] Processing CreateTablet for tablet c2ea900284d043f1920221ec9b8b3cc3 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 14:01:27.905925 4273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2ea900284d043f1920221ec9b8b3cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.913458 4352 tablet_service.cc:1467] Processing CreateTablet for tablet 5667f490d3a340fda405bcad8d32d86c (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 14:01:27.914006 4351 tablet_service.cc:1467] Processing CreateTablet for tablet 37d6068892dc40c0939974b451819ade (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 14:01:27.924553 4352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5667f490d3a340fda405bcad8d32d86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.920871 4349 tablet_service.cc:1467] Processing CreateTablet for tablet 8398c277e182475eb9d42e97a0a15ca2 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 14:01:27.925304 4348 tablet_service.cc:1467] Processing CreateTablet for tablet c2ea900284d043f1920221ec9b8b3cc3 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 14:01:27.925839 4345 tablet_service.cc:1467] Processing CreateTablet for tablet 6b7511eb5e014c2088d80bf5e71d68a6 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 14:01:27.926880 4344 tablet_service.cc:1467] Processing CreateTablet for tablet 48edcd15e8574e8b9a6800e22f1a55e0 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 14:01:27.928568 4351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d6068892dc40c0939974b451819ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.924923 4347 tablet_service.cc:1467] Processing CreateTablet for tablet ecbb4e1fc48f41dc96598a918ac24025 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 14:01:27.925869 4346 tablet_service.cc:1467] Processing CreateTablet for tablet 1ca23eacd4514e81bdf19eef1ecc802f (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 14:01:27.921931 4350 tablet_service.cc:1467] Processing CreateTablet for tablet 2223b1853419470ca3c323d16103d40b (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 14:01:27.938297 4349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8398c277e182475eb9d42e97a0a15ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.941973 4350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223b1853419470ca3c323d16103d40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.943603 4346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ca23eacd4514e81bdf19eef1ecc802f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.948735 4347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecbb4e1fc48f41dc96598a918ac24025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.949074 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b7511eb5e014c2088d80bf5e71d68a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.954442 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48edcd15e8574e8b9a6800e22f1a55e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.954809 4348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2ea900284d043f1920221ec9b8b3cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.962424 4476 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:27.980554 4476 tablet_bootstrap.cc:654] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:27.980700 4421 tablet_service.cc:1467] Processing CreateTablet for tablet ecbb4e1fc48f41dc96598a918ac24025 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 14:01:27.980752 4426 tablet_service.cc:1467] Processing CreateTablet for tablet 5667f490d3a340fda405bcad8d32d86c (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 14:01:27.981379 4421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecbb4e1fc48f41dc96598a918ac24025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.981552 4425 tablet_service.cc:1467] Processing CreateTablet for tablet 37d6068892dc40c0939974b451819ade (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 14:01:27.982280 4424 tablet_service.cc:1467] Processing CreateTablet for tablet 2223b1853419470ca3c323d16103d40b (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 14:01:27.983016 4423 tablet_service.cc:1467] Processing CreateTablet for tablet 8398c277e182475eb9d42e97a0a15ca2 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 14:01:27.983704 4422 tablet_service.cc:1467] Processing CreateTablet for tablet c2ea900284d043f1920221ec9b8b3cc3 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 14:01:27.984939 4425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d6068892dc40c0939974b451819ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.988617 4424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223b1853419470ca3c323d16103d40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.992224 4476 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:27.992453 4476 ts_tablet_manager.cc:1367] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.001s
I20240501 14:01:27.992524 4423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8398c277e182475eb9d42e97a0a15ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.993666 4476 raft_consensus.cc:348] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:27.994010 4476 raft_consensus.cc:374] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:27.994118 4476 raft_consensus.cc:729] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:27.994498 4476 consensus_queue.cc:260] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:27.996508 4422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2ea900284d043f1920221ec9b8b3cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:27.999296 4476 ts_tablet_manager.cc:1398] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
I20240501 14:01:27.999749 4312 heartbeater.cc:503] Master 127.4.14.190:35093 was elected leader, sending a full tablet report...
I20240501 14:01:28.000761 4426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5667f490d3a340fda405bcad8d32d86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:28.009020 4480 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.010856 4476 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.012784 4476 tablet_bootstrap.cc:654] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.013316 4480 tablet_bootstrap.cc:654] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.017866 4476 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.018069 4476 ts_tablet_manager.cc:1367] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20240501 14:01:28.018982 4476 raft_consensus.cc:348] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.019272 4476 raft_consensus.cc:374] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.019480 4476 raft_consensus.cc:729] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.019802 4476 consensus_queue.cc:260] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.025929 4424 tablet_service.cc:1467] Processing CreateTablet for tablet 1ca23eacd4514e81bdf19eef1ecc802f (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 14:01:28.026443 4424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ca23eacd4514e81bdf19eef1ecc802f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:28.030426 4476 ts_tablet_manager.cc:1398] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s
I20240501 14:01:28.030639 4421 tablet_service.cc:1467] Processing CreateTablet for tablet 48edcd15e8574e8b9a6800e22f1a55e0 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 14:01:28.031773 4423 tablet_service.cc:1467] Processing CreateTablet for tablet 6b7511eb5e014c2088d80bf5e71d68a6 (DEFAULT_TABLE table=test-workload [id=f0fdadd50d8949a0913b1b3124d6553b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 14:01:28.034605 4421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48edcd15e8574e8b9a6800e22f1a55e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:28.035037 4476 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.037503 4423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b7511eb5e014c2088d80bf5e71d68a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:28.039404 4480 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.039919 4477 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.039940 4480 ts_tablet_manager.cc:1367] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.004s
I20240501 14:01:28.048517 4480 raft_consensus.cc:348] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.048802 4480 raft_consensus.cc:374] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.049170 4480 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.049543 4480 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.051043 4477 tablet_bootstrap.cc:654] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.051695 4476 tablet_bootstrap.cc:654] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.052624 4480 ts_tablet_manager.cc:1398] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.012s user 0.000s sys 0.004s
I20240501 14:01:28.053385 4461 heartbeater.cc:503] Master 127.4.14.190:35093 was elected leader, sending a full tablet report...
I20240501 14:01:28.054565 4479 raft_consensus.cc:482] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.054900 4479 raft_consensus.cc:504] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.056635 4480 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.060194 4479 leader_election.cc:288] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.077881 4476 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.078604 4480 tablet_bootstrap.cc:654] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.078840 4477 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.078967 4476 ts_tablet_manager.cc:1367] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.001s
I20240501 14:01:28.079022 4477 ts_tablet_manager.cc:1367] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.043s user 0.016s sys 0.004s
I20240501 14:01:28.081535 4476 raft_consensus.cc:348] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.082821 4476 raft_consensus.cc:374] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.082863 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.083806 4477 raft_consensus.cc:348] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.084044 4477 raft_consensus.cc:374] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.084165 4477 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.084496 4477 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.084805 4476 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.085868 4476 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
W20240501 14:01:28.087860 4250 leader_election.cc:341] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:01:28.088435 4476 ts_tablet_manager.cc:1398] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20240501 14:01:28.089934 4476 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.091820 4477 ts_tablet_manager.cc:1398] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20240501 14:01:28.092135 4477 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.092234 4387 heartbeater.cc:503] Master 127.4.14.190:35093 was elected leader, sending a full tablet report...
I20240501 14:01:28.093964 4480 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.094142 4480 ts_tablet_manager.cc:1367] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.005s
I20240501 14:01:28.093890 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.094738 4476 tablet_bootstrap.cc:654] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
W20240501 14:01:28.094944 4250 leader_election.cc:341] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:01:28.095120 4250 leader_election.cc:302] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9804f6169505461c805cdc65dec8e41a; no voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:28.095050 4480 raft_consensus.cc:348] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.095914 4479 raft_consensus.cc:2726] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:01:28.096207 4480 raft_consensus.cc:374] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.096413 4480 raft_consensus.cc:729] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.096895 4480 consensus_queue.cc:260] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.099647 4476 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.100311 4477 tablet_bootstrap.cc:654] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.101346 4476 ts_tablet_manager.cc:1367] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20240501 14:01:28.101399 4480 ts_tablet_manager.cc:1398] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240501 14:01:28.101734 4480 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.102175 4476 raft_consensus.cc:348] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.102427 4476 raft_consensus.cc:374] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.102506 4476 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.102779 4476 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.103456 4476 ts_tablet_manager.cc:1398] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:28.103610 4480 tablet_bootstrap.cc:654] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.103786 4476 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.105587 4476 tablet_bootstrap.cc:654] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.113318 4477 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.113370 4476 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.113538 4477 ts_tablet_manager.cc:1367] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.005s
I20240501 14:01:28.114257 4476 ts_tablet_manager.cc:1367] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20240501 14:01:28.114612 4480 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.114764 4480 ts_tablet_manager.cc:1367] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20240501 14:01:28.114985 4477 raft_consensus.cc:348] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.115240 4477 raft_consensus.cc:374] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.115321 4477 raft_consensus.cc:729] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.115490 4480 raft_consensus.cc:348] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.115706 4480 raft_consensus.cc:374] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.115619 4477 consensus_queue.cc:260] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.115809 4480 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.115595 4476 raft_consensus.cc:348] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.116099 4480 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.116611 4476 raft_consensus.cc:374] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.116775 4476 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.117094 4476 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.117820 4480 ts_tablet_manager.cc:1398] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:01:28.118146 4480 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.116304 4477 ts_tablet_manager.cc:1398] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:01:28.120144 4476 ts_tablet_manager.cc:1398] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 14:01:28.120553 4476 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
W20240501 14:01:28.120857 4313 tablet.cc:2369] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 14:01:28.122172 4480 tablet_bootstrap.cc:654] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.122319 4476 tablet_bootstrap.cc:654] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.124485 4477 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.126117 4477 tablet_bootstrap.cc:654] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.130939 4476 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.130939 4480 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.131187 4476 ts_tablet_manager.cc:1367] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20240501 14:01:28.131296 4480 ts_tablet_manager.cc:1367] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20240501 14:01:28.132038 4480 raft_consensus.cc:348] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.132038 4476 raft_consensus.cc:348] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.132483 4480 raft_consensus.cc:374] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.132459 4476 raft_consensus.cc:374] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.132651 4476 raft_consensus.cc:729] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.132655 4480 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.133026 4480 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.133004 4476 consensus_queue.cc:260] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.134097 4477 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.134266 4477 ts_tablet_manager.cc:1367] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20240501 14:01:28.135170 4477 raft_consensus.cc:348] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.135388 4477 raft_consensus.cc:374] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.135491 4477 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.135882 4480 ts_tablet_manager.cc:1398] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:01:28.135831 4477 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.136461 4477 ts_tablet_manager.cc:1398] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 14:01:28.136575 4476 ts_tablet_manager.cc:1398] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240501 14:01:28.136749 4477 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.136931 4476 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.137611 4480 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.138635 4477 tablet_bootstrap.cc:654] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.139644 4480 tablet_bootstrap.cc:654] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.140985 4477 tablet_bootstrap.cc:492] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.141165 4477 ts_tablet_manager.cc:1367] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20240501 14:01:28.142037 4480 tablet_bootstrap.cc:492] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.142043 4477 raft_consensus.cc:348] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.142196 4480 ts_tablet_manager.cc:1367] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 14:01:28.142310 4477 raft_consensus.cc:374] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.142408 4477 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.142596 4476 tablet_bootstrap.cc:654] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.142736 4477 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.143013 4480 raft_consensus.cc:348] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.143203 4480 raft_consensus.cc:374] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.143308 4480 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.143453 4477 ts_tablet_manager.cc:1398] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:01:28.143577 4480 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.143744 4477 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.145085 4480 ts_tablet_manager.cc:1398] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:01:28.145382 4480 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.145489 4477 tablet_bootstrap.cc:654] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.147147 4480 tablet_bootstrap.cc:654] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.153409 4476 tablet_bootstrap.cc:492] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.153565 4477 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.153566 4480 tablet_bootstrap.cc:492] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.153602 4476 ts_tablet_manager.cc:1367] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.003s
I20240501 14:01:28.153776 4480 ts_tablet_manager.cc:1367] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20240501 14:01:28.153774 4477 ts_tablet_manager.cc:1367] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20240501 14:01:28.154680 4476 raft_consensus.cc:348] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.154762 4477 raft_consensus.cc:348] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.154971 4476 raft_consensus.cc:374] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.154999 4477 raft_consensus.cc:374] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.155078 4476 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.155121 4477 raft_consensus.cc:729] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.154709 4480 raft_consensus.cc:348] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.155413 4480 raft_consensus.cc:374] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.155517 4480 raft_consensus.cc:729] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.155352 4477 consensus_queue.cc:260] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.155789 4480 consensus_queue.cc:260] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.156160 4477 ts_tablet_manager.cc:1398] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:01:28.156468 4480 ts_tablet_manager.cc:1398] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:01:28.156512 4477 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.156787 4480 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.155351 4476 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.158551 4480 tablet_bootstrap.cc:654] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.159109 4476 ts_tablet_manager.cc:1398] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 14:01:28.159562 4476 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.158555 4477 tablet_bootstrap.cc:654] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.164675 4476 tablet_bootstrap.cc:654] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.165261 4477 tablet_bootstrap.cc:492] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.165479 4477 ts_tablet_manager.cc:1367] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20240501 14:01:28.166203 4477 raft_consensus.cc:348] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.166433 4480 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.166481 4477 raft_consensus.cc:374] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.166575 4477 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.166579 4480 ts_tablet_manager.cc:1367] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20240501 14:01:28.166930 4477 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.167495 4477 ts_tablet_manager.cc:1398] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:01:28.167598 4480 raft_consensus.cc:348] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.167775 4480 raft_consensus.cc:374] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.167902 4477 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.169051 4476 tablet_bootstrap.cc:492] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.169638 4477 tablet_bootstrap.cc:654] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.170717 4476 ts_tablet_manager.cc:1367] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20240501 14:01:28.171721 4477 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.171592 4476 raft_consensus.cc:348] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.171849 4476 raft_consensus.cc:374] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.171886 4477 ts_tablet_manager.cc:1367] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:01:28.171963 4476 raft_consensus.cc:729] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.172274 4476 consensus_queue.cc:260] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.172684 4477 raft_consensus.cc:348] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.172844 4476 ts_tablet_manager.cc:1398] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:01:28.170682 4480 raft_consensus.cc:729] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.172902 4477 raft_consensus.cc:374] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.173002 4477 raft_consensus.cc:729] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.173151 4480 consensus_queue.cc:260] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.173238 4477 consensus_queue.cc:260] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.173913 4477 ts_tablet_manager.cc:1398] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:01:28.174203 4476 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: Bootstrap starting.
I20240501 14:01:28.174279 4477 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.174876 4480 ts_tablet_manager.cc:1398] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240501 14:01:28.175325 4480 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.176445 4477 tablet_bootstrap.cc:654] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.177039 4480 tablet_bootstrap.cc:654] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.178496 4476 tablet_bootstrap.cc:654] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.179477 4480 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.179733 4480 ts_tablet_manager.cc:1367] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:01:28.180689 4480 raft_consensus.cc:348] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.181039 4480 raft_consensus.cc:374] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.181210 4480 raft_consensus.cc:729] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.181594 4480 consensus_queue.cc:260] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.182287 4480 ts_tablet_manager.cc:1398] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:28.182652 4480 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Bootstrap starting.
I20240501 14:01:28.184748 4480 tablet_bootstrap.cc:654] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.188472 4477 tablet_bootstrap.cc:492] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.188724 4477 ts_tablet_manager.cc:1367] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.011s
I20240501 14:01:28.189152 4476 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: No bootstrap required, opened a new log
I20240501 14:01:28.189249 4480 tablet_bootstrap.cc:492] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: No bootstrap required, opened a new log
I20240501 14:01:28.189316 4476 ts_tablet_manager.cc:1367] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20240501 14:01:28.189424 4480 ts_tablet_manager.cc:1367] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240501 14:01:28.189671 4477 raft_consensus.cc:348] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.189947 4477 raft_consensus.cc:374] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.190048 4477 raft_consensus.cc:729] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.190075 4476 raft_consensus.cc:348] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.190250 4476 raft_consensus.cc:374] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.190351 4480 raft_consensus.cc:348] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.190373 4476 raft_consensus.cc:729] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.190560 4480 raft_consensus.cc:374] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.190414 4477 consensus_queue.cc:260] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.190660 4480 raft_consensus.cc:729] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.190747 4476 consensus_queue.cc:260] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.190915 4480 consensus_queue.cc:260] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.191308 4477 ts_tablet_manager.cc:1398] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:28.191545 4480 ts_tablet_manager.cc:1398] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:28.191691 4477 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: Bootstrap starting.
I20240501 14:01:28.192023 4476 ts_tablet_manager.cc:1398] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20240501 14:01:28.194114 4477 tablet_bootstrap.cc:654] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:28.197392 4477 tablet_bootstrap.cc:492] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: No bootstrap required, opened a new log
I20240501 14:01:28.197551 4477 ts_tablet_manager.cc:1367] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 14:01:28.198148 4477 raft_consensus.cc:348] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.198328 4477 raft_consensus.cc:374] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:28.198421 4477 raft_consensus.cc:729] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Initialized, Role: FOLLOWER
I20240501 14:01:28.198668 4477 consensus_queue.cc:260] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.199189 4477 ts_tablet_manager.cc:1398] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:01:28.213165 4487 raft_consensus.cc:482] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.213140 4479 raft_consensus.cc:482] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.213443 4479 raft_consensus.cc:504] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.213440 4487 raft_consensus.cc:504] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.214268 4479 leader_election.cc:288] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.214432 4487 leader_election.cc:288] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.214824 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.214859 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.215184 4436 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.215379 4362 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.215705 4250 leader_election.cc:302] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.216320 4479 raft_consensus.cc:2781] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.216464 4479 raft_consensus.cc:482] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.216575 4479 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.219784 4479 raft_consensus.cc:504] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.220921 4479 leader_election.cc:288] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.221634 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.221753 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.222028 4362 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.222054 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.222421 4287 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.222767 4436 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.222995 4328 leader_election.cc:302] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.223413 4487 raft_consensus.cc:2781] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.223549 4487 raft_consensus.cc:482] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.223647 4487 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.223703 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.224193 4435 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.225479 4362 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.225885 4250 leader_election.cc:302] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.226271 4436 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.226719 4487 raft_consensus.cc:504] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.227339 4487 leader_election.cc:288] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.227540 4487 raft_consensus.cc:482] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.227680 4487 raft_consensus.cc:504] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.227788 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.227811 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.228027 4287 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.228358 4487 leader_election.cc:288] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.228809 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.229028 4479 raft_consensus.cc:2781] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.228022 4436 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.229125 4286 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.229765 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.230108 4435 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.230600 4328 leader_election.cc:302] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.231989 4487 raft_consensus.cc:2781] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.231995 4287 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.232158 4487 raft_consensus.cc:482] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.232304 4487 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.234283 4487 raft_consensus.cc:504] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.234941 4487 leader_election.cc:288] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.235584 4512 raft_consensus.cc:482] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.235635 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.235846 4435 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.236225 4479 raft_consensus.cc:686] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.235774 4512 raft_consensus.cc:504] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.237074 4479 consensus_queue.cc:237] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.240535 4328 leader_election.cc:302] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.240873 4436 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.241485 4487 raft_consensus.cc:2781] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.241699 4487 raft_consensus.cc:686] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:28.241745 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.242025 4436 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.242105 4487 consensus_queue.cc:237] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.242355 4250 leader_election.cc:302] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.244349 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.245201 4512 leader_election.cc:288] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.247578 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.247954 4362 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.247619 4287 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.248149 4183 catalog_manager.cc:5484] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 1 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.248118 4182 catalog_manager.cc:5484] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.247722 4435 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.250239 4325 leader_election.cc:302] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:28.247524 4513 raft_consensus.cc:2781] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.250505 4487 raft_consensus.cc:2781] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.250624 4513 raft_consensus.cc:482] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.250739 4487 raft_consensus.cc:686] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:28.250774 4513 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.251046 4487 consensus_queue.cc:237] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.251637 4287 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.253458 4513 raft_consensus.cc:504] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.254539 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.254750 4362 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.257120 4362 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.257539 4250 leader_election.cc:302] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.257666 4513 leader_election.cc:288] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.257835 4513 raft_consensus.cc:2781] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.258224 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.258472 4435 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.258443 4513 raft_consensus.cc:686] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.258358 4182 catalog_manager.cc:5484] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.258785 4513 consensus_queue.cc:237] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:28.261543 4435 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.261914 4183 catalog_manager.cc:5484] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 1 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:28.281114 4487 raft_consensus.cc:482] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.281333 4487 raft_consensus.cc:504] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.282114 4487 leader_election.cc:288] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.282609 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b7511eb5e014c2088d80bf5e71d68a6" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.282826 4435 raft_consensus.cc:2454] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.282795 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b7511eb5e014c2088d80bf5e71d68a6" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.283031 4287 raft_consensus.cc:2454] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 0.
I20240501 14:01:28.283234 4325 leader_election.cc:302] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:28.283514 4487 raft_consensus.cc:2781] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.283633 4487 raft_consensus.cc:482] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.283732 4487 raft_consensus.cc:3037] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.285727 4487 raft_consensus.cc:504] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.286324 4487 leader_election.cc:288] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.286793 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b7511eb5e014c2088d80bf5e71d68a6" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.286815 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b7511eb5e014c2088d80bf5e71d68a6" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.286972 4435 raft_consensus.cc:3037] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.286980 4287 raft_consensus.cc:3037] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.287237 4483 raft_consensus.cc:482] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.287386 4483 raft_consensus.cc:504] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.288647 4483 leader_election.cc:288] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.289288 4483 raft_consensus.cc:482] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.289500 4483 raft_consensus.cc:504] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.290222 4483 leader_election.cc:288] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.290344 4287 raft_consensus.cc:2454] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.291419 4328 leader_election.cc:302] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.291816 4435 raft_consensus.cc:2454] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 1.
I20240501 14:01:28.293030 4487 raft_consensus.cc:2781] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.293313 4487 raft_consensus.cc:686] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:28.293715 4487 consensus_queue.cc:237] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.296783 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.297044 4286 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.297382 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.297447 4402 leader_election.cc:302] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.297714 4483 raft_consensus.cc:2781] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.297811 4483 raft_consensus.cc:482] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.297914 4483 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.298131 4287 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.298633 4402 leader_election.cc:302] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.298959 4361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.298991 4183 catalog_manager.cc:5484] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.299296 4361 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.298626 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.299602 4362 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.300701 4520 raft_consensus.cc:2781] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.300810 4520 raft_consensus.cc:482] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.300849 4483 raft_consensus.cc:504] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.300942 4520 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.301460 4483 leader_election.cc:288] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.301951 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.302192 4362 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.302564 4287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.302784 4287 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.304314 4520 raft_consensus.cc:504] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.304797 4362 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.305269 4399 leader_election.cc:302] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:28.305517 4520 leader_election.cc:288] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.305548 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.305702 4520 raft_consensus.cc:2781] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.305742 4287 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.305747 4286 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.305855 4520 raft_consensus.cc:686] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.306510 4520 consensus_queue.cc:237] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.308226 4286 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.308413 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.308616 4362 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.308802 4402 leader_election.cc:302] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.309132 4520 raft_consensus.cc:2781] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.309389 4520 raft_consensus.cc:686] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.309356 4183 catalog_manager.cc:5484] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:28.309681 4520 consensus_queue.cc:237] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.311381 4362 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.313963 4183 catalog_manager.cc:5484] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:28.362490 4520 raft_consensus.cc:482] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.362732 4520 raft_consensus.cc:504] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.363380 4520 leader_election.cc:288] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.363984 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a" is_pre_election: true
I20240501 14:01:28.363984 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.364313 4286 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.364362 4362 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 0.
I20240501 14:01:28.364753 4402 leader_election.cc:302] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.365054 4520 raft_consensus.cc:2781] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.365154 4520 raft_consensus.cc:482] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.365252 4520 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.367161 4520 raft_consensus.cc:504] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.367851 4520 leader_election.cc:288] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:28.368299 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.368299 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.368561 4286 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.368605 4362 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.371665 4362 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.372052 4399 leader_election.cc:302] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:28.372119 4286 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 1.
I20240501 14:01:28.372406 4520 raft_consensus.cc:2781] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.372586 4520 raft_consensus.cc:686] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.372854 4520 consensus_queue.cc:237] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.375669 4183 catalog_manager.cc:5484] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
W20240501 14:01:28.494534 4231 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 14:01:28.537407 4513 raft_consensus.cc:482] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:28.537663 4513 raft_consensus.cc:504] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.538439 4513 leader_election.cc:288] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.539027 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" is_pre_election: true
I20240501 14:01:28.539109 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" is_pre_election: true
I20240501 14:01:28.539300 4362 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.539359 4435 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 0.
I20240501 14:01:28.539745 4250 leader_election.cc:302] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.540037 4513 raft_consensus.cc:2781] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:28.540138 4513 raft_consensus.cc:482] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:28.540280 4513 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.542184 4513 raft_consensus.cc:504] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.542757 4513 leader_election.cc:288] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.543277 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.543362 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.543521 4362 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.543524 4435 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:28.546555 4435 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.546555 4362 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 1.
I20240501 14:01:28.547087 4250 leader_election.cc:302] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.547412 4513 raft_consensus.cc:2781] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:28.547560 4513 raft_consensus.cc:686] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.547854 4513 consensus_queue.cc:237] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.550719 4183 catalog_manager.cc:5484] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 1 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.619800 4513 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.630911 4362 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:57330
I20240501 14:01:28.631244 4362 raft_consensus.cc:595] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:28.631675 4513 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.632275 4487 consensus_queue.cc:1035] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.641673 4511 consensus_queue.cc:1035] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.642259 4435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:59936
I20240501 14:01:28.642472 4435 raft_consensus.cc:595] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:28.644956 4436 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:59936
I20240501 14:01:28.645143 4436 raft_consensus.cc:595] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:28.648276 4513 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.652643 4513 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.652702 4287 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:56164
I20240501 14:01:28.652925 4287 raft_consensus.cc:595] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:28.656656 4436 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:59936
I20240501 14:01:28.656895 4436 raft_consensus.cc:595] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:28.661010 4287 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:56164
I20240501 14:01:28.661208 4287 raft_consensus.cc:595] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Received request to transfer leadership to TS 6c0bc1bf7c2f418d92cee0802c3cd3c6
I20240501 14:01:28.678439 4511 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.680877 4511 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.684376 4511 raft_consensus.cc:979] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.684588 4487 raft_consensus.cc:1067] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.685855 4287 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56160
I20240501 14:01:28.686120 4287 raft_consensus.cc:482] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:28.686261 4287 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.688118 4487 consensus_queue.cc:1035] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.689468 4287 raft_consensus.cc:504] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.690567 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.690668 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.690863 4436 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.690955 4362 raft_consensus.cc:3032] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:28.691053 4362 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:28.691413 4362 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.692025 4362 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.690572 4287 leader_election.cc:288] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.693842 4436 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.694262 4250 leader_election.cc:302] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.694581 4513 raft_consensus.cc:2781] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:28.694774 4513 raft_consensus.cc:686] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.695027 4362 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.695093 4513 consensus_queue.cc:237] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.698459 4511 consensus_queue.cc:1035] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.699244 4183 catalog_manager.cc:5484] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 1 to 2, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 2 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.705801 4520 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.711668 4483 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.714210 4542 raft_consensus.cc:979] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.714361 4542 raft_consensus.cc:1067] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.715015 4286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56162
I20240501 14:01:28.715219 4286 raft_consensus.cc:482] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:28.715351 4286 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.717271 4286 raft_consensus.cc:504] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.717916 4286 leader_election.cc:288] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.718317 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.718544 4362 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.718752 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.718936 4436 raft_consensus.cc:3032] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:28.719053 4436 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.719355 4436 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.719753 4436 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.721686 4362 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.722121 4250 leader_election.cc:302] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.722422 4512 raft_consensus.cc:2781] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:28.722462 4436 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.722594 4512 raft_consensus.cc:686] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.723001 4512 consensus_queue.cc:237] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.725122 4542 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.725427 4183 catalog_manager.cc:5484] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 1 to 2, leader changed from 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 2 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.729708 4542 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.732373 4520 raft_consensus.cc:979] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.732544 4520 raft_consensus.cc:1067] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:28.733148 4286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56162
I20240501 14:01:28.733331 4286 raft_consensus.cc:482] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:28.733443 4286 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.735846 4286 raft_consensus.cc:504] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.736421 4286 leader_election.cc:288] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.736878 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:28.736953 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.737072 4362 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.737102 4436 raft_consensus.cc:3032] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:28.737190 4436 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.737445 4436 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.737776 4436 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.739347 4362 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.739722 4250 leader_election.cc:302] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:28.739768 4436 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:28.740028 4512 raft_consensus.cc:2781] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:28.740216 4512 raft_consensus.cc:686] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:28.740552 4512 consensus_queue.cc:237] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.742903 4182 catalog_manager.cc:5484] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 1 to 2, leader changed from 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 2 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:28.900990 4520 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.905891 4483 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:28.909735 4542 raft_consensus.cc:979] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:28.909932 4542 raft_consensus.cc:1067] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:28.910655 4362 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57316
I20240501 14:01:28.910879 4362 raft_consensus.cc:482] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:28.910984 4362 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.912952 4362 raft_consensus.cc:504] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.913646 4362 leader_election.cc:288] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:28.914235 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:28.914433 4436 raft_consensus.cc:3032] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:28.914554 4436 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:28.914866 4436 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.915302 4436 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.915403 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:28.915585 4286 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:28.918414 4436 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:28.918414 4286 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:28.919024 4325 leader_election.cc:302] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:28.919376 4511 raft_consensus.cc:2781] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:28.919554 4511 raft_consensus.cc:686] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:28.919855 4511 consensus_queue.cc:237] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:28.922245 4182 catalog_manager.cc:5484] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 1 to 2, leader changed from 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:29.014973 4512 consensus_queue.cc:1035] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:29.019600 4513 consensus_queue.cc:1035] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:29.022487 4512 raft_consensus.cc:979] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:29.022655 4512 raft_consensus.cc:1067] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Signalling peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:29.023344 4436 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:59930
I20240501 14:01:29.023523 4436 raft_consensus.cc:482] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:29.023672 4436 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.025849 4436 raft_consensus.cc:504] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.026449 4436 leader_election.cc:288] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:29.026849 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:29.027031 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48edcd15e8574e8b9a6800e22f1a55e0" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:29.027055 4286 raft_consensus.cc:3032] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:29.027259 4362 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.027328 4286 raft_consensus.cc:729] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:29.027618 4286 consensus_queue.cc:260] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.027967 4286 raft_consensus.cc:3037] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.029448 4362 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 2.
I20240501 14:01:29.029862 4399 leader_election.cc:302] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:29.030093 4286 raft_consensus.cc:2454] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 2.
I20240501 14:01:29.030135 4542 raft_consensus.cc:2781] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:29.030313 4542 raft_consensus.cc:686] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:29.030622 4542 consensus_queue.cc:237] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.032931 4183 catalog_manager.cc:5484] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 1 to 2, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 2 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:29.060904 4513 raft_consensus.cc:979] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:29.061128 4512 raft_consensus.cc:1067] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:29.061767 4362 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57312
I20240501 14:01:29.061980 4362 raft_consensus.cc:482] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:29.062088 4362 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.064076 4362 raft_consensus.cc:504] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.064754 4362 leader_election.cc:288] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:29.065244 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:29.065187 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:29.065447 4436 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.065472 4286 raft_consensus.cc:3032] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:29.065562 4286 raft_consensus.cc:729] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:29.065850 4286 consensus_queue.cc:260] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.066237 4286 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:29.068410 4436 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:29.068850 4325 leader_election.cc:302] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:29.068935 4286 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:29.069134 4511 raft_consensus.cc:2781] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:29.069306 4511 raft_consensus.cc:686] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:29.069584 4511 consensus_queue.cc:237] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:29.071842 4183 catalog_manager.cc:5484] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 1 to 2, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:29.079752 4362 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.080329 4512 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.084095 4436 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.084597 4512 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.133513 4362 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.134102 4512 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.137504 4436 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.138020 4513 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.167084 4362 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.167701 4513 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.171358 4436 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.171945 4512 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.392441 4436 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.393121 4538 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.396543 4286 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.397389 4487 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.453583 4362 raft_consensus.cc:1261] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.454277 4542 consensus_queue.cc:1035] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.457516 4286 raft_consensus.cc:1261] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.458233 4550 consensus_queue.cc:1035] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.485929 4286 raft_consensus.cc:1261] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.486541 4487 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:29.490006 4436 raft_consensus.cc:1261] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:29.490736 4538 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:31.671571 4154 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240501 14:01:31.671943 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:31.680127 4286 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:45312
I20240501 14:01:31.680398 4286 raft_consensus.cc:595] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Received request to transfer leadership to TS 6c0bc1bf7c2f418d92cee0802c3cd3c6
I20240501 14:01:31.686865 4362 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:31.687141 4362 raft_consensus.cc:595] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Received request to transfer leadership to TS 6c0bc1bf7c2f418d92cee0802c3cd3c6
I20240501 14:01:31.687709 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 14:01:31.688002 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:31.755345 4557 raft_consensus.cc:979] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:31.755538 4557 raft_consensus.cc:1067] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Signalling peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:31.756253 4436 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:59932
I20240501 14:01:31.756496 4436 raft_consensus.cc:482] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:31.756595 4436 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.758778 4436 raft_consensus.cc:504] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.759507 4436 leader_election.cc:288] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:31.759935 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:31.759991 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:31.760123 4286 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.760236 4362 raft_consensus.cc:3032] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:31.760347 4362 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:31.760633 4362 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.760994 4362 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.762410 4286 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:31.762948 4402 leader_election.cc:302] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:31.763068 4362 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:31.763315 4553 raft_consensus.cc:2781] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:31.763908 4553 raft_consensus.cc:686] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:31.764252 4553 consensus_queue.cc:237] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.766961 4183 catalog_manager.cc:5484] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 2 to 3, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:31.780138 4512 raft_consensus.cc:979] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:31.780372 4512 raft_consensus.cc:1067] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Signalling peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:31.781041 4436 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:59930
I20240501 14:01:31.781289 4436 raft_consensus.cc:482] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:31.781406 4436 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.783488 4436 raft_consensus.cc:504] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.784214 4436 leader_election.cc:288] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:31.784739 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:31.784744 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:31.785012 4362 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.785018 4286 raft_consensus.cc:3032] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:31.785151 4286 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:31.785440 4286 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.785868 4286 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:31.788210 4362 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:31.788636 4286 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:31.788724 4399 leader_election.cc:302] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:31.789055 4553 raft_consensus.cc:2781] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:31.789212 4553 raft_consensus.cc:686] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:31.789497 4553 consensus_queue.cc:237] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:31.792151 4183 catalog_manager.cc:5484] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 2 to 3, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:32.242377 4362 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:32.243021 4553 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:32.247110 4286 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:32.248309 4558 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:32.294003 4286 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:32.294755 4553 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:32.298408 4362 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:32.300032 4558 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:32.688493 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:32.690156 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:32.690348 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:33.690773 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:33.692660 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:33.692842 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:34.693291 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:34.694876 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:34.695062 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:35.695508 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:35.697221 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:35.697400 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:36.697880 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:36.700343 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:36.700603 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:37.701041 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:37.702709 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:37.702905 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:38.703411 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:38.705200 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:38.705427 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:39.705929 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:39.707752 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:39.707945 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:40.708456 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:40.710299 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:40.710515 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:41.721158 4154 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240501 14:01:41.723094 4286 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:56164
I20240501 14:01:41.723356 4286 raft_consensus.cc:595] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:41.725432 4435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:59936
I20240501 14:01:41.725663 4435 raft_consensus.cc:595] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:41.727591 4286 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:56164
I20240501 14:01:41.727792 4286 raft_consensus.cc:595] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:41.729719 4286 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:56164
I20240501 14:01:41.729920 4286 raft_consensus.cc:595] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:41.732720 4435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
mode: GRACEFUL
new_leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:59936
I20240501 14:01:41.732900 4435 raft_consensus.cc:595] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Received request to transfer leadership to TS 7d96d96c919f4fc6a3a3f4a715b00b66
I20240501 14:01:41.802573 4512 raft_consensus.cc:979] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.802743 4512 raft_consensus.cc:1067] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.803483 4361 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57312
I20240501 14:01:41.803695 4361 raft_consensus.cc:482] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:41.803799 4361 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.805842 4361 raft_consensus.cc:504] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.806516 4361 leader_election.cc:288] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 3 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:41.807024 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:41.807264 4435 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.807216 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:41.807430 4286 raft_consensus.cc:3032] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:41.807551 4286 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:41.807896 4286 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.808266 4286 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.809770 4435 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 3.
I20240501 14:01:41.810318 4286 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 3.
I20240501 14:01:41.810285 4325 leader_election.cc:302] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:41.810649 4576 raft_consensus.cc:2781] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:41.811041 4576 raft_consensus.cc:686] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:41.811371 4576 consensus_queue.cc:237] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.813966 4182 catalog_manager.cc:5484] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 2 to 3, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 3 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:41.850698 4512 raft_consensus.cc:979] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.850916 4512 raft_consensus.cc:1067] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.851624 4361 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57312
I20240501 14:01:41.851848 4361 raft_consensus.cc:482] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:41.851936 4361 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.853969 4361 raft_consensus.cc:504] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.854621 4361 leader_election.cc:288] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 3 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:41.855268 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:41.855263 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:41.855505 4286 raft_consensus.cc:3032] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:41.855532 4435 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.855590 4286 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:41.855906 4286 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.856299 4286 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:41.858031 4435 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 3.
I20240501 14:01:41.858476 4325 leader_election.cc:302] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:41.858601 4286 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 3.
I20240501 14:01:41.858996 4578 raft_consensus.cc:2781] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:41.859496 4578 raft_consensus.cc:686] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:41.859802 4578 consensus_queue.cc:237] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.862658 4182 catalog_manager.cc:5484] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 2 to 3, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 3 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:41.919093 4574 raft_consensus.cc:979] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.919272 4574 raft_consensus.cc:1067] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:41.919972 4361 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57316
I20240501 14:01:41.920157 4361 raft_consensus.cc:482] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:41.920322 4361 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:41.922262 4361 raft_consensus.cc:504] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.922894 4361 leader_election.cc:288] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 4 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:41.923389 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:41.923389 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecbb4e1fc48f41dc96598a918ac24025" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:41.923689 4286 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:41.923730 4436 raft_consensus.cc:3032] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:01:41.923807 4436 raft_consensus.cc:729] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:41.924101 4436 consensus_queue.cc:260] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.924520 4436 raft_consensus.cc:3037] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:41.926798 4286 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 4.
I20240501 14:01:41.927222 4436 raft_consensus.cc:2454] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 4.
I20240501 14:01:41.927289 4328 leader_election.cc:302] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:41.927625 4578 raft_consensus.cc:2781] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:01:41.927814 4578 raft_consensus.cc:686] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:41.928085 4578 consensus_queue.cc:237] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:41.930939 4182 catalog_manager.cc:5484] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 3 to 4, leader changed from 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 4 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:42.016227 4577 raft_consensus.cc:979] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:42.016408 4577 raft_consensus.cc:1067] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:42.017184 4361 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57312
I20240501 14:01:42.017410 4361 raft_consensus.cc:482] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:42.017517 4361 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:42.020035 4361 raft_consensus.cc:504] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:42.020709 4361 leader_election.cc:288] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Requested vote from peers 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493), 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339)
I20240501 14:01:42.021206 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:42.021210 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:42.021478 4286 raft_consensus.cc:3032] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:42.021476 4436 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:42.021608 4286 raft_consensus.cc:729] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:42.021890 4286 consensus_queue.cc:260] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:42.022224 4286 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:42.023727 4436 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:42.024216 4325 leader_election.cc:302] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:42.024334 4286 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 2.
I20240501 14:01:42.024519 4578 raft_consensus.cc:2781] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:42.024672 4578 raft_consensus.cc:686] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:42.024976 4578 consensus_queue.cc:237] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:42.027822 4182 catalog_manager.cc:5484] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 1 to 2, leader changed from 9804f6169505461c805cdc65dec8e41a (127.4.14.129) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:42.044342 4586 raft_consensus.cc:979] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: : Instructing follower 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:42.044579 4586 raft_consensus.cc:1067] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Signalling peer 7d96d96c919f4fc6a3a3f4a715b00b66 to start an election
I20240501 14:01:42.045329 4361 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37d6068892dc40c0939974b451819ade"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
from {username='slave'} at 127.0.0.1:57316
I20240501 14:01:42.045516 4361 raft_consensus.cc:482] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:42.045632 4361 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:42.047606 4361 raft_consensus.cc:504] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:42.048287 4361 leader_election.cc:288] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 4 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:42.048804 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:42.048756 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d6068892dc40c0939974b451819ade" candidate_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:42.049029 4436 raft_consensus.cc:3032] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:01:42.049033 4286 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:42.049168 4436 raft_consensus.cc:729] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:42.049459 4436 consensus_queue.cc:260] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:42.049865 4436 raft_consensus.cc:3037] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:42.052233 4286 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 4.
I20240501 14:01:42.052626 4436 raft_consensus.cc:2454] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d96d96c919f4fc6a3a3f4a715b00b66 in term 4.
I20240501 14:01:42.052753 4328 leader_election.cc:302] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:42.053110 4578 raft_consensus.cc:2781] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:01:42.053269 4578 raft_consensus.cc:686] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 LEADER]: Becoming Leader. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:42.053579 4578 consensus_queue.cc:237] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:42.056110 4182 catalog_manager.cc:5484] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 reported cstate change: term changed from 3 to 4, leader changed from 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131) to 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130). New cstate: current_term: 4 leader_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:42.394037 4286 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:42.394665 4578 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:42.399796 4436 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:42.400369 4584 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:42.402989 4436 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:42.403467 4584 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:42.407260 4286 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:42.407948 4584 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:42.421002 4436 raft_consensus.cc:1261] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:42.421608 4584 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:42.425289 4286 raft_consensus.cc:1261] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:42.426067 4584 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:42.518124 4286 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:42.518710 4584 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:42.522253 4436 raft_consensus.cc:1261] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:42.522850 4596 consensus_queue.cc:1035] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20240501 14:01:42.625823 4286 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:42.626418 4584 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:42.630666 4436 raft_consensus.cc:1261] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 7d96d96c919f4fc6a3a3f4a715b00b66: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:42.631456 4603 consensus_queue.cc:1035] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:44.746923 4154 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240501 14:01:44.747164 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:44.749529 4361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:44.749799 4361 raft_consensus.cc:595] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:44.750845 4361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:44.751051 4361 raft_consensus.cc:595] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:44.751971 4361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:44.752142 4361 raft_consensus.cc:595] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Received request to transfer leadership to TS 6c0bc1bf7c2f418d92cee0802c3cd3c6
I20240501 14:01:44.753046 4361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:44.753227 4361 raft_consensus.cc:595] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Received request to transfer leadership to TS 6c0bc1bf7c2f418d92cee0802c3cd3c6
I20240501 14:01:44.754276 4361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3"
dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
mode: GRACEFUL
new_leader_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:46030
I20240501 14:01:44.754451 4361 raft_consensus.cc:595] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Received request to transfer leadership to TS 9804f6169505461c805cdc65dec8e41a
I20240501 14:01:44.754851 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240501 14:01:44.755040 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:44.842804 4603 raft_consensus.cc:979] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:44.843035 4607 raft_consensus.cc:1067] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:44.843775 4286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2223b1853419470ca3c323d16103d40b"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56160
I20240501 14:01:44.844013 4286 raft_consensus.cc:482] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:44.844148 4286 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.844328 4603 raft_consensus.cc:979] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:44.844492 4607 raft_consensus.cc:1067] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Signalling peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:44.845167 4436 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:59932
I20240501 14:01:44.845362 4436 raft_consensus.cc:482] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:44.845472 4436 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:44.846644 4286 raft_consensus.cc:504] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.847523 4286 leader_election.cc:288] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 4 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:44.847553 4436 raft_consensus.cc:504] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:44.848048 4361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:44.848075 4435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223b1853419470ca3c323d16103d40b" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:44.848357 4361 raft_consensus.cc:3032] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:01:44.848367 4435 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.848464 4361 raft_consensus.cc:729] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:44.848770 4361 consensus_queue.cc:260] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.849186 4361 raft_consensus.cc:3037] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.849346 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:44.849537 4362 raft_consensus.cc:3032] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:44.849629 4362 raft_consensus.cc:729] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:44.849920 4362 consensus_queue.cc:260] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:44.850239 4362 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:44.850872 4435 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 4.
I20240501 14:01:44.851318 4250 leader_election.cc:302] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:44.851898 4608 raft_consensus.cc:2781] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:01:44.852249 4361 raft_consensus.cc:2454] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 4.
I20240501 14:01:44.853117 4362 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:44.853281 4436 leader_election.cc:288] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339)
I20240501 14:01:44.853750 4399 leader_election.cc:302] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:44.853854 4607 raft_consensus.cc:979] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:44.853981 4607 raft_consensus.cc:1067] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Signalling peer 6c0bc1bf7c2f418d92cee0802c3cd3c6 to start an election
I20240501 14:01:44.854112 4586 raft_consensus.cc:2781] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:44.854197 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5667f490d3a340fda405bcad8d32d86c" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:44.854496 4286 raft_consensus.cc:3037] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:44.854921 4435 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2"
dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
from {username='slave'} at 127.0.0.1:59932
I20240501 14:01:44.855171 4435 raft_consensus.cc:482] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:44.855315 4435 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.857980 4286 raft_consensus.cc:2454] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 3.
I20240501 14:01:44.858934 4435 raft_consensus.cc:504] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.860409 4286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9804f6169505461c805cdc65dec8e41a"
I20240501 14:01:44.860596 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8398c277e182475eb9d42e97a0a15ca2" candidate_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:44.860739 4286 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.860810 4362 raft_consensus.cc:3032] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:01:44.860901 4362 raft_consensus.cc:729] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:44.861433 4362 consensus_queue.cc:260] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.861764 4362 raft_consensus.cc:3037] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:01:44.863960 4362 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 4.
I20240501 14:01:44.864537 4286 raft_consensus.cc:2454] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0bc1bf7c2f418d92cee0802c3cd3c6 in term 4.
I20240501 14:01:44.860515 4435 leader_election.cc:288] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers 9804f6169505461c805cdc65dec8e41a (127.4.14.129:34339), 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753)
I20240501 14:01:44.864673 4399 leader_election.cc:302] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c0bc1bf7c2f418d92cee0802c3cd3c6, 7d96d96c919f4fc6a3a3f4a715b00b66; no voters:
I20240501 14:01:44.868796 4610 raft_consensus.cc:2781] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:01:44.869033 4610 raft_consensus.cc:686] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:44.869304 4610 consensus_queue.cc:237] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.870374 4586 raft_consensus.cc:686] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c0bc1bf7c2f418d92cee0802c3cd3c6, State: Running, Role: LEADER
I20240501 14:01:44.870744 4586 consensus_queue.cc:237] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } }
I20240501 14:01:44.872036 4608 raft_consensus.cc:686] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 4 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:44.872437 4608 consensus_queue.cc:237] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:44.873659 4182 catalog_manager.cc:5484] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 2 to 3, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:44.875265 4183 catalog_manager.cc:5484] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 3 to 4, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 4 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:44.880864 4183 catalog_manager.cc:5484] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 reported cstate change: term changed from 3 to 4, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131). New cstate: current_term: 4 leader_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:45.018256 4603 raft_consensus.cc:979] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:45.018492 4607 raft_consensus.cc:1067] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:45.019201 4286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56160
I20240501 14:01:45.019634 4286 raft_consensus.cc:482] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:45.019776 4286 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:45.022055 4286 raft_consensus.cc:504] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.022810 4286 leader_election.cc:288] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 3 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:45.023449 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:45.023715 4362 raft_consensus.cc:3032] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:45.023713 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2ea900284d043f1920221ec9b8b3cc3" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:45.023840 4362 raft_consensus.cc:729] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:45.023964 4436 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:45.024206 4362 consensus_queue.cc:260] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.024590 4362 raft_consensus.cc:3037] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:45.027202 4436 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 3.
I20240501 14:01:45.027442 4362 raft_consensus.cc:2454] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 3.
I20240501 14:01:45.027841 4250 leader_election.cc:302] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:45.028158 4608 raft_consensus.cc:2781] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:45.028364 4608 raft_consensus.cc:686] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 3 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:45.028643 4608 consensus_queue.cc:237] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.032241 4183 catalog_manager.cc:5484] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 2 to 3, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 3 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:45.202186 4603 raft_consensus.cc:979] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: : Instructing follower 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:45.202386 4603 raft_consensus.cc:1067] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Signalling peer 9804f6169505461c805cdc65dec8e41a to start an election
I20240501 14:01:45.203146 4286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f"
dest_uuid: "9804f6169505461c805cdc65dec8e41a"
from {username='slave'} at 127.0.0.1:56160
I20240501 14:01:45.203397 4286 raft_consensus.cc:482] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:45.203558 4286 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:45.205952 4286 raft_consensus.cc:504] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.206650 4286 leader_election.cc:288] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Requested vote from peers 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753), 6c0bc1bf7c2f418d92cee0802c3cd3c6 (127.4.14.131:41493)
I20240501 14:01:45.207262 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66"
I20240501 14:01:45.207274 4436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ca23eacd4514e81bdf19eef1ecc802f" candidate_uuid: "9804f6169505461c805cdc65dec8e41a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6"
I20240501 14:01:45.207479 4362 raft_consensus.cc:3032] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:45.207576 4362 raft_consensus.cc:729] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d96d96c919f4fc6a3a3f4a715b00b66, State: Running, Role: LEADER
I20240501 14:01:45.207579 4436 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:45.207903 4362 consensus_queue.cc:260] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.208329 4362 raft_consensus.cc:3037] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:45.210749 4362 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:45.210935 4436 raft_consensus.cc:2454] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9804f6169505461c805cdc65dec8e41a in term 2.
I20240501 14:01:45.211248 4250 leader_election.cc:302] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d96d96c919f4fc6a3a3f4a715b00b66, 9804f6169505461c805cdc65dec8e41a; no voters:
I20240501 14:01:45.211596 4608 raft_consensus.cc:2781] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:45.211753 4608 raft_consensus.cc:686] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Becoming Leader. State: Replica: 9804f6169505461c805cdc65dec8e41a, State: Running, Role: LEADER
I20240501 14:01:45.212090 4608 consensus_queue.cc:237] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } }
I20240501 14:01:45.215315 4183 catalog_manager.cc:5484] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a reported cstate change: term changed from 1 to 2, leader changed from 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130) to 9804f6169505461c805cdc65dec8e41a (127.4.14.129). New cstate: current_term: 2 leader_uuid: "9804f6169505461c805cdc65dec8e41a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:45.328982 4362 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:45.329841 4610 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:45.335940 4286 raft_consensus.cc:1261] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:45.336618 4586 consensus_queue.cc:1035] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:45.351490 4286 raft_consensus.cc:1261] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:45.352121 4610 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9804f6169505461c805cdc65dec8e41a" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:45.355904 4362 raft_consensus.cc:1261] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Refusing update from remote peer 6c0bc1bf7c2f418d92cee0802c3cd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:45.356528 4611 consensus_queue.cc:1035] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:45.386653 4362 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:45.387418 4608 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:45.391031 4436 raft_consensus.cc:1261] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:01:45.391800 4630 consensus_queue.cc:1035] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:01:45.442242 4362 raft_consensus.cc:1261] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:45.442883 4609 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:45.446960 4436 raft_consensus.cc:1261] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:45.447670 4609 consensus_queue.cc:1035] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:45.602411 4436 raft_consensus.cc:1261] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:45.603071 4609 consensus_queue.cc:1035] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0bc1bf7c2f418d92cee0802c3cd3c6" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:45.606743 4362 raft_consensus.cc:1261] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Refusing update from remote peer 9804f6169505461c805cdc65dec8e41a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:45.607950 4630 consensus_queue.cc:1035] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d96d96c919f4fc6a3a3f4a715b00b66" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:45.766590 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:45.768745 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:45.768950 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:46.775627 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:46.777356 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:46.777527 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:47.777954 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:47.779556 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:47.779753 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:48.780253 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:48.781965 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:48.782151 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:49.782603 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:49.784221 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:49.784412 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:50.784864 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:50.786465 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:50.786643 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:51.787303 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:51.789188 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:51.789392 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:52.789891 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:52.791695 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:52.791901 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:53.792364 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:53.794111 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:01:53.794343 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:54.805307 4154 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240501 14:01:54.805635 4154 tablet_server.cc:178] TabletServer@127.4.14.129:0 shutting down...
I20240501 14:01:54.818979 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:01:54.819357 4154 tablet_replica.cc:330] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.819847 4154 raft_consensus.cc:2229] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 3 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.820356 4154 raft_consensus.cc:2258] T c2ea900284d043f1920221ec9b8b3cc3 P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.821827 4154 tablet_replica.cc:330] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.822013 4154 raft_consensus.cc:2229] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.822211 4154 raft_consensus.cc:2258] T 48edcd15e8574e8b9a6800e22f1a55e0 P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.822748 4154 tablet_replica.cc:330] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.822896 4154 raft_consensus.cc:2229] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.823074 4154 raft_consensus.cc:2258] T 8398c277e182475eb9d42e97a0a15ca2 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.823562 4154 tablet_replica.cc:330] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.823756 4154 raft_consensus.cc:2229] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 2 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.824049 4154 raft_consensus.cc:2258] T 1ca23eacd4514e81bdf19eef1ecc802f P 9804f6169505461c805cdc65dec8e41a [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.824558 4154 tablet_replica.cc:330] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.824702 4154 raft_consensus.cc:2229] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.824862 4154 raft_consensus.cc:2258] T 6b7511eb5e014c2088d80bf5e71d68a6 P 9804f6169505461c805cdc65dec8e41a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.825274 4154 tablet_replica.cc:330] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.825425 4154 raft_consensus.cc:2229] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.825564 4154 raft_consensus.cc:2258] T 37d6068892dc40c0939974b451819ade P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.826203 4154 tablet_replica.cc:330] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.826356 4154 raft_consensus.cc:2229] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.826658 4154 raft_consensus.cc:2258] T 2223b1853419470ca3c323d16103d40b P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.827138 4154 tablet_replica.cc:330] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.827296 4154 raft_consensus.cc:2229] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.827448 4154 raft_consensus.cc:2258] T ecbb4e1fc48f41dc96598a918ac24025 P 9804f6169505461c805cdc65dec8e41a [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.827935 4154 tablet_replica.cc:330] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a: stopping tablet replica
I20240501 14:01:54.828050 4154 raft_consensus.cc:2229] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.828223 4154 raft_consensus.cc:2258] T 5667f490d3a340fda405bcad8d32d86c P 9804f6169505461c805cdc65dec8e41a [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.846868 4154 tablet_server.cc:194] TabletServer@127.4.14.129:0 shutdown complete.
I20240501 14:01:54.854441 4154 tablet_server.cc:178] TabletServer@127.4.14.130:0 shutting down...
I20240501 14:01:54.864199 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:01:54.864517 4154 tablet_replica.cc:330] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.864737 4154 raft_consensus.cc:2229] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.864976 4154 raft_consensus.cc:2258] T c2ea900284d043f1920221ec9b8b3cc3 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.865739 4154 tablet_replica.cc:330] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.865916 4154 raft_consensus.cc:2229] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.866107 4154 raft_consensus.cc:2258] T 1ca23eacd4514e81bdf19eef1ecc802f P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Raft consensus is shut down!
W20240501 14:01:54.866108 4399 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20240501 14:01:54.866706 4154 tablet_replica.cc:330] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.866873 4154 raft_consensus.cc:2229] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.867197 4154 raft_consensus.cc:2258] T 6b7511eb5e014c2088d80bf5e71d68a6 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 1 FOLLOWER]: Raft consensus is shut down!
W20240501 14:01:54.867712 4399 consensus_peers.cc:485] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 -> Peer 7d96d96c919f4fc6a3a3f4a715b00b66 (127.4.14.130:46753): Couldn't send request to peer 7d96d96c919f4fc6a3a3f4a715b00b66. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:01:54.867833 4154 tablet_replica.cc:330] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.868013 4154 raft_consensus.cc:2229] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.868345 4154 raft_consensus.cc:2258] T 37d6068892dc40c0939974b451819ade P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.868819 4154 tablet_replica.cc:330] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.868964 4154 raft_consensus.cc:2229] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.869122 4154 raft_consensus.cc:2258] T 8398c277e182475eb9d42e97a0a15ca2 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.869565 4154 tablet_replica.cc:330] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.869705 4154 raft_consensus.cc:2229] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.869848 4154 raft_consensus.cc:2258] T 2223b1853419470ca3c323d16103d40b P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.870291 4154 tablet_replica.cc:330] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.870429 4154 raft_consensus.cc:2229] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.870589 4154 raft_consensus.cc:2258] T 5667f490d3a340fda405bcad8d32d86c P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.870998 4154 tablet_replica.cc:330] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.871140 4154 raft_consensus.cc:2229] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.871429 4154 raft_consensus.cc:2258] T ecbb4e1fc48f41dc96598a918ac24025 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.871861 4154 tablet_replica.cc:330] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66: stopping tablet replica
I20240501 14:01:54.871973 4154 raft_consensus.cc:2229] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.872157 4154 raft_consensus.cc:2258] T 48edcd15e8574e8b9a6800e22f1a55e0 P 7d96d96c919f4fc6a3a3f4a715b00b66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.888314 4154 tablet_server.cc:194] TabletServer@127.4.14.130:0 shutdown complete.
I20240501 14:01:54.893381 4154 tablet_server.cc:178] TabletServer@127.4.14.131:0 shutting down...
I20240501 14:01:54.902842 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:01:54.903187 4154 tablet_replica.cc:330] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.903409 4154 raft_consensus.cc:2229] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.903645 4154 raft_consensus.cc:2258] T 1ca23eacd4514e81bdf19eef1ecc802f P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.904356 4154 tablet_replica.cc:330] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.904531 4154 raft_consensus.cc:2229] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.904840 4154 raft_consensus.cc:2258] T 48edcd15e8574e8b9a6800e22f1a55e0 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.905354 4154 tablet_replica.cc:330] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.905501 4154 raft_consensus.cc:2229] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.905675 4154 raft_consensus.cc:2258] T c2ea900284d043f1920221ec9b8b3cc3 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.906136 4154 tablet_replica.cc:330] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.906328 4154 raft_consensus.cc:2229] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.906498 4154 raft_consensus.cc:2258] T 6b7511eb5e014c2088d80bf5e71d68a6 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.906956 4154 tablet_replica.cc:330] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.907094 4154 raft_consensus.cc:2229] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.907243 4154 raft_consensus.cc:2258] T 37d6068892dc40c0939974b451819ade P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.907671 4154 tablet_replica.cc:330] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.907822 4154 raft_consensus.cc:2229] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.908102 4154 raft_consensus.cc:2258] T 8398c277e182475eb9d42e97a0a15ca2 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.908596 4154 tablet_replica.cc:330] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.908722 4154 raft_consensus.cc:2229] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.908892 4154 raft_consensus.cc:2258] T 2223b1853419470ca3c323d16103d40b P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.909292 4154 tablet_replica.cc:330] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.909432 4154 raft_consensus.cc:2229] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:01:54.909565 4154 raft_consensus.cc:2258] T ecbb4e1fc48f41dc96598a918ac24025 P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.910001 4154 tablet_replica.cc:330] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6: stopping tablet replica
I20240501 14:01:54.910111 4154 raft_consensus.cc:2229] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.910409 4154 raft_consensus.cc:2258] T 5667f490d3a340fda405bcad8d32d86c P 6c0bc1bf7c2f418d92cee0802c3cd3c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.926079 4154 tablet_server.cc:194] TabletServer@127.4.14.131:0 shutdown complete.
I20240501 14:01:54.931129 4154 master.cc:537] Master@127.4.14.190:35093 shutting down...
I20240501 14:01:54.940515 4154 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 1 LEADER]: Raft consensus shutting down.
I20240501 14:01:54.940802 4154 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:01:54.940951 4154 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7f307938bb8d49d790a76c2372c593d5: stopping tablet replica
I20240501 14:01:54.955600 4154 master.cc:552] Master@127.4.14.190:35093 shutdown complete.
6c0bc1bf7c2f418d92cee0802c3cd3c6 1
7d96d96c919f4fc6a3a3f4a715b00b66 4
9804f6169505461c805cdc65dec8e41a 4
6c0bc1bf7c2f418d92cee0802c3cd3c6 3
7d96d96c919f4fc6a3a3f4a715b00b66 3
9804f6169505461c805cdc65dec8e41a 3
6c0bc1bf7c2f418d92cee0802c3cd3c6 1
7d96d96c919f4fc6a3a3f4a715b00b66 8
9804f6169505461c805cdc65dec8e41a 0
6c0bc1bf7c2f418d92cee0802c3cd3c6 3
7d96d96c919f4fc6a3a3f4a715b00b66 3
9804f6169505461c805cdc65dec8e41a 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27622 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240501 14:01:54.974500 4154 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.14.190:35917
I20240501 14:01:54.975154 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:54.978730 4645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:54.979131 4644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:54.979679 4154 server_base.cc:1034] running on GCE node
W20240501 14:01:54.980243 4647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:54.980649 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:54.980722 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:54.980772 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572114980744 us; error 0 us; skew 500 ppm
I20240501 14:01:54.980996 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:54.982425 4154 webserver.cc:460] Webserver started at http://127.4.14.190:38387/ using document root <none> and password file <none>
I20240501 14:01:54.982684 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:54.982782 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:54.982932 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:54.983657 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/master-0-root/instance:
uuid: "e92c9cedde8f43ae80517f1d925240ac"
format_stamp: "Formatted at 2024-05-01 14:01:54 on dist-test-slave-78f7"
I20240501 14:01:54.986445 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20240501 14:01:54.988312 4652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:54.988708 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 14:01:54.988821 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/master-0-root
uuid: "e92c9cedde8f43ae80517f1d925240ac"
format_stamp: "Formatted at 2024-05-01 14:01:54 on dist-test-slave-78f7"
I20240501 14:01:54.988976 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:55.002831 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:55.003533 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:55.018666 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.190:35917
I20240501 14:01:55.018702 4703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.190:35917 every 8 connection(s)
I20240501 14:01:55.020143 4704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.024533 4704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac: Bootstrap starting.
I20240501 14:01:55.025903 4704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.027909 4704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac: No bootstrap required, opened a new log
I20240501 14:01:55.028630 4704 raft_consensus.cc:348] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER }
I20240501 14:01:55.028791 4704 raft_consensus.cc:374] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.028852 4704 raft_consensus.cc:729] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92c9cedde8f43ae80517f1d925240ac, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.029065 4704 consensus_queue.cc:260] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER }
I20240501 14:01:55.029228 4704 raft_consensus.cc:388] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:01:55.029289 4704 raft_consensus.cc:482] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:01:55.029366 4704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.031255 4704 raft_consensus.cc:504] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER }
I20240501 14:01:55.031493 4704 leader_election.cc:302] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e92c9cedde8f43ae80517f1d925240ac; no voters:
I20240501 14:01:55.031909 4704 leader_election.cc:288] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:01:55.032083 4707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.032682 4707 raft_consensus.cc:686] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 1 LEADER]: Becoming Leader. State: Replica: e92c9cedde8f43ae80517f1d925240ac, State: Running, Role: LEADER
I20240501 14:01:55.032982 4707 consensus_queue.cc:237] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER }
I20240501 14:01:55.033092 4704 sys_catalog.cc:564] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:01:55.034209 4708 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e92c9cedde8f43ae80517f1d925240ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER } }
I20240501 14:01:55.034274 4709 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader e92c9cedde8f43ae80517f1d925240ac. Latest consensus state: current_term: 1 leader_uuid: "e92c9cedde8f43ae80517f1d925240ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92c9cedde8f43ae80517f1d925240ac" member_type: VOTER } }
I20240501 14:01:55.034523 4709 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [sys.catalog]: This master's current role is: LEADER
I20240501 14:01:55.034999 4708 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [sys.catalog]: This master's current role is: LEADER
I20240501 14:01:55.035636 4713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:01:55.038048 4713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:01:55.038709 4154 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 14:01:55.041743 4713 catalog_manager.cc:1347] Generated new cluster ID: 6ce4e23b13a54b29899fdf164786d138
I20240501 14:01:55.041842 4713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:01:55.058245 4713 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:01:55.059067 4713 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:01:55.069262 4713 catalog_manager.cc:5857] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac: Generated new TSK 0
I20240501 14:01:55.069541 4713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:01:55.072149 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:55.075680 4725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.076354 4726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.076877 4728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:55.077435 4154 server_base.cc:1034] running on GCE node
I20240501 14:01:55.077734 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:55.077812 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:55.077869 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572115077853 us; error 0 us; skew 500 ppm
I20240501 14:01:55.078176 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:55.079684 4154 webserver.cc:460] Webserver started at http://127.4.14.129:35147/ using document root <none> and password file <none>
I20240501 14:01:55.079952 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:55.080029 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:55.080221 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:55.080937 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-0-root/instance:
uuid: "e5e8df89e78d4476a1e647f0316e257e"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.083736 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 14:01:55.085757 4733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.086189 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 14:01:55.086305 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
uuid: "e5e8df89e78d4476a1e647f0316e257e"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.086431 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:55.110164 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:55.110843 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:55.111497 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:55.112484 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:55.112574 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.112654 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:55.112707 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.128913 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.129:34559
I20240501 14:01:55.128932 4795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.129:34559 every 8 connection(s)
I20240501 14:01:55.130728 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:55.135006 4800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.135613 4801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.136283 4803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:55.136572 4154 server_base.cc:1034] running on GCE node
I20240501 14:01:55.136989 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:55.137087 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:55.137185 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572115137131 us; error 0 us; skew 500 ppm
I20240501 14:01:55.137400 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:55.139179 4154 webserver.cc:460] Webserver started at http://127.4.14.130:35681/ using document root <none> and password file <none>
I20240501 14:01:55.139529 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:55.139657 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:55.139853 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:55.140812 4796 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35917
I20240501 14:01:55.140831 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-1-root/instance:
uuid: "06fa1aefd7694132978f68c92457c6c8"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.140973 4796 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:55.141436 4796 heartbeater.cc:511] Master 127.4.14.190:35917 requested a full tablet report, sending...
I20240501 14:01:55.142469 4669 ts_manager.cc:194] Registered new tserver with Master: e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559)
I20240501 14:01:55.144104 4669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53272
I20240501 14:01:55.144322 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20240501 14:01:55.146335 4808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.146736 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 14:01:55.146996 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
uuid: "06fa1aefd7694132978f68c92457c6c8"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.147315 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:55.159292 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:55.160408 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:55.161091 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:55.162143 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:55.162214 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.162297 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:55.162346 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.177909 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.130:34239
I20240501 14:01:55.177925 4870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.130:34239 every 8 connection(s)
I20240501 14:01:55.179632 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:01:55.183238 4874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.183799 4875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:01:55.184068 4877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:01:55.185091 4154 server_base.cc:1034] running on GCE node
I20240501 14:01:55.185436 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:01:55.185559 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:01:55.185622 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572115185600 us; error 0 us; skew 500 ppm
I20240501 14:01:55.185845 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:01:55.187199 4871 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35917
I20240501 14:01:55.187366 4871 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:55.187451 4154 webserver.cc:460] Webserver started at http://127.4.14.131:43307/ using document root <none> and password file <none>
I20240501 14:01:55.187709 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:01:55.187784 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:01:55.187790 4871 heartbeater.cc:511] Master 127.4.14.190:35917 requested a full tablet report, sending...
I20240501 14:01:55.187947 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:01:55.188733 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-2-root/instance:
uuid: "8e938bc7d5ae465ba95e6629b014f932"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.188970 4669 ts_manager.cc:194] Registered new tserver with Master: 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.189819 4669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53276
I20240501 14:01:55.192045 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:01:55.194105 4882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.194557 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 14:01:55.194667 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
uuid: "8e938bc7d5ae465ba95e6629b014f932"
format_stamp: "Formatted at 2024-05-01 14:01:55 on dist-test-slave-78f7"
I20240501 14:01:55.194797 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714572087283996-4154-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:01:55.207656 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:01:55.208412 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:01:55.209138 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:01:55.210081 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:01:55.210167 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.210245 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:01:55.210301 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:01:55.226526 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.131:43409
I20240501 14:01:55.226573 4944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.131:43409 every 8 connection(s)
I20240501 14:01:55.234958 4945 heartbeater.cc:347] Connected to a master server at 127.4.14.190:35917
I20240501 14:01:55.235141 4945 heartbeater.cc:464] Registering TS with master...
I20240501 14:01:55.235579 4945 heartbeater.cc:511] Master 127.4.14.190:35917 requested a full tablet report, sending...
I20240501 14:01:55.236524 4669 ts_manager.cc:194] Registered new tserver with Master: 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.236930 4154 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00922761s
I20240501 14:01:55.237423 4669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53292
I20240501 14:01:55.238251 4154 test_util.cc:268] Using random seed: -304161460
I20240501 14:01:55.252764 4669 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53304:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 14:01:55.254115 4669 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 14:01:55.288101 4910 tablet_service.cc:1467] Processing CreateTablet for tablet e7501d8c96924fa19f4045735bd261db (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 14:01:55.288352 4908 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9563bc227c4ddf9496cc255ba39ef9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 14:01:55.288551 4907 tablet_service.cc:1467] Processing CreateTablet for tablet 0567d1ca9b624fe9980db88a3fed0d74 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 14:01:55.288936 4908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9563bc227c4ddf9496cc255ba39ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.288988 4905 tablet_service.cc:1467] Processing CreateTablet for tablet 128abbd925d64626b0414eb35011b25a (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 14:01:55.289441 4905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 128abbd925d64626b0414eb35011b25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.292076 4907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0567d1ca9b624fe9980db88a3fed0d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.292768 4903 tablet_service.cc:1467] Processing CreateTablet for tablet 257d757fec9e48e187ce34614eba5ece (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 14:01:55.293365 4904 tablet_service.cc:1467] Processing CreateTablet for tablet 319d402878654a8fbfc5014a478c6ca2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 14:01:55.289438 4909 tablet_service.cc:1467] Processing CreateTablet for tablet ac72552c32424e48a5dcef5e877c67e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 14:01:55.293977 4904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319d402878654a8fbfc5014a478c6ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.294131 4906 tablet_service.cc:1467] Processing CreateTablet for tablet 17f94681048a4627857a0e4907aee34f (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 14:01:55.294433 4901 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ff5fd428440a9a8dcd7aeb7176e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 14:01:55.296684 4903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257d757fec9e48e187ce34614eba5ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.296967 4909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac72552c32424e48a5dcef5e877c67e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.296028 4902 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 14:01:55.299674 4760 tablet_service.cc:1467] Processing CreateTablet for tablet ac72552c32424e48a5dcef5e877c67e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 14:01:55.300556 4758 tablet_service.cc:1467] Processing CreateTablet for tablet 0567d1ca9b624fe9980db88a3fed0d74 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 14:01:55.300956 4760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac72552c32424e48a5dcef5e877c67e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.301534 4906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f94681048a4627857a0e4907aee34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.299714 4761 tablet_service.cc:1467] Processing CreateTablet for tablet e7501d8c96924fa19f4045735bd261db (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 14:01:55.301749 4759 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9563bc227c4ddf9496cc255ba39ef9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 14:01:55.301810 4757 tablet_service.cc:1467] Processing CreateTablet for tablet 17f94681048a4627857a0e4907aee34f (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 14:01:55.305665 4758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0567d1ca9b624fe9980db88a3fed0d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.305002 4754 tablet_service.cc:1467] Processing CreateTablet for tablet 257d757fec9e48e187ce34614eba5ece (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 14:01:55.306501 4901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ff5fd428440a9a8dcd7aeb7176e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.305864 4756 tablet_service.cc:1467] Processing CreateTablet for tablet 128abbd925d64626b0414eb35011b25a (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 14:01:55.307825 4902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.307773 4755 tablet_service.cc:1467] Processing CreateTablet for tablet 319d402878654a8fbfc5014a478c6ca2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 14:01:55.310258 4761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7501d8c96924fa19f4045735bd261db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.313203 4910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7501d8c96924fa19f4045735bd261db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.313560 4753 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 14:01:55.314975 4757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f94681048a4627857a0e4907aee34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.313490 4752 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ff5fd428440a9a8dcd7aeb7176e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 14:01:55.317490 4754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257d757fec9e48e187ce34614eba5ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.321189 4756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 128abbd925d64626b0414eb35011b25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.317446 4835 tablet_service.cc:1467] Processing CreateTablet for tablet ac72552c32424e48a5dcef5e877c67e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 14:01:55.324232 4834 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9563bc227c4ddf9496cc255ba39ef9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 14:01:55.325361 4753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.326184 4832 tablet_service.cc:1467] Processing CreateTablet for tablet 17f94681048a4627857a0e4907aee34f (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 14:01:55.326350 4752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ff5fd428440a9a8dcd7aeb7176e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.327138 4835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac72552c32424e48a5dcef5e877c67e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.332688 4759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9563bc227c4ddf9496cc255ba39ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.331928 4836 tablet_service.cc:1467] Processing CreateTablet for tablet e7501d8c96924fa19f4045735bd261db (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 14:01:55.333941 4833 tablet_service.cc:1467] Processing CreateTablet for tablet 0567d1ca9b624fe9980db88a3fed0d74 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 14:01:55.334738 4834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9563bc227c4ddf9496cc255ba39ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.335247 4831 tablet_service.cc:1467] Processing CreateTablet for tablet 128abbd925d64626b0414eb35011b25a (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 14:01:55.339661 4755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319d402878654a8fbfc5014a478c6ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.341223 4836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7501d8c96924fa19f4045735bd261db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.340099 4827 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ff5fd428440a9a8dcd7aeb7176e9 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 14:01:55.343690 4833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0567d1ca9b624fe9980db88a3fed0d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.346326 4831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 128abbd925d64626b0414eb35011b25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.341135 4830 tablet_service.cc:1467] Processing CreateTablet for tablet 319d402878654a8fbfc5014a478c6ca2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 14:01:55.343719 4828 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2 (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 14:01:55.341863 4829 tablet_service.cc:1467] Processing CreateTablet for tablet 257d757fec9e48e187ce34614eba5ece (DEFAULT_TABLE table=test-workload [id=539118db83094379bfcc2ce0dacbb2fe]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 14:01:55.355383 4832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f94681048a4627857a0e4907aee34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.356911 4827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ff5fd428440a9a8dcd7aeb7176e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.364198 4828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1bc10ded8847ef9b5b01d414cd2bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.378989 4830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319d402878654a8fbfc5014a478c6ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.385777 4829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 257d757fec9e48e187ce34614eba5ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:01:55.392146 4960 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.447122 4961 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.459648 4960 tablet_bootstrap.cc:654] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.461320 4962 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.466281 4961 tablet_bootstrap.cc:654] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.471120 4962 tablet_bootstrap.cc:654] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.471311 4961 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.471516 4961 ts_tablet_manager.cc:1367] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20240501 14:01:55.472565 4961 raft_consensus.cc:348] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.472833 4961 raft_consensus.cc:374] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.472944 4961 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.473186 4962 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.473345 4962 ts_tablet_manager.cc:1367] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240501 14:01:55.473237 4961 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.474295 4796 heartbeater.cc:503] Master 127.4.14.190:35917 was elected leader, sending a full tablet report...
I20240501 14:01:55.474231 4962 raft_consensus.cc:348] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.474300 4961 ts_tablet_manager.cc:1398] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240501 14:01:55.474436 4962 raft_consensus.cc:374] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.474532 4962 raft_consensus.cc:729] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.474650 4961 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.474807 4962 consensus_queue.cc:260] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.475118 4960 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.475265 4960 ts_tablet_manager.cc:1367] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.007s
I20240501 14:01:55.476083 4960 raft_consensus.cc:348] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.476301 4960 raft_consensus.cc:374] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.476395 4960 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.476512 4961 tablet_bootstrap.cc:654] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.476649 4960 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.481748 4871 heartbeater.cc:503] Master 127.4.14.190:35917 was elected leader, sending a full tablet report...
I20240501 14:01:55.481971 4960 ts_tablet_manager.cc:1398] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20240501 14:01:55.482187 4945 heartbeater.cc:503] Master 127.4.14.190:35917 was elected leader, sending a full tablet report...
I20240501 14:01:55.483235 4962 ts_tablet_manager.cc:1398] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.009s user 0.002s sys 0.007s
I20240501 14:01:55.483583 4962 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.485472 4960 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.485702 4962 tablet_bootstrap.cc:654] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.486291 4961 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.486483 4961 ts_tablet_manager.cc:1367] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20240501 14:01:55.487224 4960 tablet_bootstrap.cc:654] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.487603 4961 raft_consensus.cc:348] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.487974 4961 raft_consensus.cc:374] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.488062 4961 raft_consensus.cc:729] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.488451 4961 consensus_queue.cc:260] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.489073 4961 ts_tablet_manager.cc:1398] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 14:01:55.491895 4961 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.493254 4960 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.493461 4960 ts_tablet_manager.cc:1367] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240501 14:01:55.493702 4961 tablet_bootstrap.cc:654] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.494386 4960 raft_consensus.cc:348] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.494535 4962 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.494701 4960 raft_consensus.cc:374] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.494822 4962 ts_tablet_manager.cc:1367] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20240501 14:01:55.494827 4960 raft_consensus.cc:729] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.495214 4960 consensus_queue.cc:260] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.495765 4962 raft_consensus.cc:348] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.495990 4961 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.495997 4962 raft_consensus.cc:374] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.496109 4962 raft_consensus.cc:729] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.496150 4961 ts_tablet_manager.cc:1367] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:01:55.496400 4962 consensus_queue.cc:260] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.497051 4962 ts_tablet_manager.cc:1398] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:55.497047 4961 raft_consensus.cc:348] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.497305 4961 raft_consensus.cc:374] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.497368 4962 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.497421 4961 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.497705 4961 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.498080 4960 ts_tablet_manager.cc:1398] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:01:55.499205 4962 tablet_bootstrap.cc:654] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.501281 4962 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.501438 4962 ts_tablet_manager.cc:1367] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20240501 14:01:55.501981 4960 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.502283 4962 raft_consensus.cc:348] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.502506 4962 raft_consensus.cc:374] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.502614 4962 raft_consensus.cc:729] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.502913 4962 consensus_queue.cc:260] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.503535 4962 ts_tablet_manager.cc:1398] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:01:55.503858 4962 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.505519 4960 tablet_bootstrap.cc:654] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.505662 4962 tablet_bootstrap.cc:654] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.509099 4961 ts_tablet_manager.cc:1398] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20240501 14:01:55.509864 4960 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.510046 4960 ts_tablet_manager.cc:1367] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20240501 14:01:55.510135 4962 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.510315 4962 ts_tablet_manager.cc:1367] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20240501 14:01:55.510545 4961 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.510972 4960 raft_consensus.cc:348] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.511085 4962 raft_consensus.cc:348] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.511189 4960 raft_consensus.cc:374] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.511330 4962 raft_consensus.cc:374] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.511364 4960 raft_consensus.cc:729] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.511425 4962 raft_consensus.cc:729] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.511698 4962 consensus_queue.cc:260] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.511674 4960 consensus_queue.cc:260] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.512854 4961 tablet_bootstrap.cc:654] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.512889 4962 ts_tablet_manager.cc:1398] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:01:55.513221 4962 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.514891 4960 ts_tablet_manager.cc:1398] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20240501 14:01:55.514957 4962 tablet_bootstrap.cc:654] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.517208 4960 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.517908 4961 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.518116 4961 ts_tablet_manager.cc:1367] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20240501 14:01:55.518359 4962 tablet_bootstrap.cc:492] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.518517 4962 ts_tablet_manager.cc:1367] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:01:55.518988 4961 raft_consensus.cc:348] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.519191 4960 tablet_bootstrap.cc:654] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.519234 4961 raft_consensus.cc:374] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.519182 4962 raft_consensus.cc:348] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.519344 4961 raft_consensus.cc:729] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.519415 4962 raft_consensus.cc:374] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.519551 4962 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.519703 4961 consensus_queue.cc:260] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.519824 4962 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.520298 4961 ts_tablet_manager.cc:1398] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 14:01:55.520439 4962 ts_tablet_manager.cc:1398] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:55.520591 4961 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.520774 4962 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.522426 4961 tablet_bootstrap.cc:654] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.522487 4962 tablet_bootstrap.cc:654] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.529441 4960 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.529709 4960 ts_tablet_manager.cc:1367] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20240501 14:01:55.530622 4962 tablet_bootstrap.cc:492] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.530613 4960 raft_consensus.cc:348] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.530901 4960 raft_consensus.cc:374] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.530930 4962 ts_tablet_manager.cc:1367] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20240501 14:01:55.531000 4961 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.531021 4960 raft_consensus.cc:729] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.531149 4961 ts_tablet_manager.cc:1367] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20240501 14:01:55.531399 4960 consensus_queue.cc:260] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.531654 4962 raft_consensus.cc:348] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.531855 4962 raft_consensus.cc:374] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.531955 4962 raft_consensus.cc:729] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.531921 4961 raft_consensus.cc:348] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.532106 4960 ts_tablet_manager.cc:1398] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240501 14:01:55.532126 4961 raft_consensus.cc:374] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.532323 4961 raft_consensus.cc:729] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.532476 4960 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.532358 4962 consensus_queue.cc:260] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.532618 4961 consensus_queue.cc:260] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.534420 4960 tablet_bootstrap.cc:654] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.534719 4962 ts_tablet_manager.cc:1398] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:01:55.536266 4961 ts_tablet_manager.cc:1398] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 14:01:55.536485 4962 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.537134 4961 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.537977 4960 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.538142 4960 ts_tablet_manager.cc:1367] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 14:01:55.538662 4962 tablet_bootstrap.cc:654] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.539171 4961 tablet_bootstrap.cc:654] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.539170 4960 raft_consensus.cc:348] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.539453 4960 raft_consensus.cc:374] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.539563 4960 raft_consensus.cc:729] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.539873 4960 consensus_queue.cc:260] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.540663 4960 ts_tablet_manager.cc:1398] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:55.541072 4960 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.541079 4962 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.541276 4962 ts_tablet_manager.cc:1367] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20240501 14:01:55.542251 4962 raft_consensus.cc:348] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.542474 4962 raft_consensus.cc:374] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.542583 4962 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.542824 4962 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.543226 4960 tablet_bootstrap.cc:654] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.543509 4962 ts_tablet_manager.cc:1398] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:01:55.543819 4962 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.545576 4962 tablet_bootstrap.cc:654] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.547423 4962 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.547595 4962 ts_tablet_manager.cc:1367] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:01:55.548350 4962 raft_consensus.cc:348] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.548607 4962 raft_consensus.cc:374] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.548696 4962 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.548993 4962 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.549687 4961 tablet_bootstrap.cc:492] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.549721 4962 ts_tablet_manager.cc:1398] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:01:55.549880 4961 ts_tablet_manager.cc:1367] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20240501 14:01:55.550050 4962 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.550124 4968 raft_consensus.cc:482] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.550395 4960 tablet_bootstrap.cc:492] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.550282 4968 raft_consensus.cc:504] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.550702 4961 raft_consensus.cc:348] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.550858 4960 ts_tablet_manager.cc:1367] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.004s
I20240501 14:01:55.550951 4961 raft_consensus.cc:374] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.551087 4961 raft_consensus.cc:729] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.551440 4968 leader_election.cc:288] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.551446 4961 consensus_queue.cc:260] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.552063 4962 tablet_bootstrap.cc:654] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.552018 4960 raft_consensus.cc:348] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.552376 4960 raft_consensus.cc:374] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.552526 4960 raft_consensus.cc:729] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.552873 4960 consensus_queue.cc:260] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.553093 4961 ts_tablet_manager.cc:1398] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:01:55.553478 4961 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.553691 4960 ts_tablet_manager.cc:1398] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:01:55.554860 4960 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.555733 4967 raft_consensus.cc:482] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.555910 4967 raft_consensus.cc:504] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.557090 4967 leader_election.cc:288] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.557170 4961 tablet_bootstrap.cc:654] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.557099 4960 tablet_bootstrap.cc:654] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.566154 4960 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.566524 4960 ts_tablet_manager.cc:1367] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20240501 14:01:55.567680 4960 raft_consensus.cc:348] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.568060 4960 raft_consensus.cc:374] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.568236 4960 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.568639 4960 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.573336 4960 ts_tablet_manager.cc:1398] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20240501 14:01:55.577884 4960 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.580155 4960 tablet_bootstrap.cc:654] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.581349 4967 raft_consensus.cc:482] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.581578 4967 raft_consensus.cc:504] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.582365 4967 leader_election.cc:288] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.587617 4960 tablet_bootstrap.cc:492] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.588011 4960 ts_tablet_manager.cc:1367] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20240501 14:01:55.589119 4960 raft_consensus.cc:348] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.589524 4960 raft_consensus.cc:374] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.589668 4960 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.590076 4960 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.590974 4960 ts_tablet_manager.cc:1398] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:01:55.591461 4960 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.593719 4960 tablet_bootstrap.cc:654] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.594441 4962 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.594583 4961 tablet_bootstrap.cc:492] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.594640 4962 ts_tablet_manager.cc:1367] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.045s user 0.021s sys 0.022s
I20240501 14:01:55.594779 4961 ts_tablet_manager.cc:1367] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.027s
I20240501 14:01:55.595551 4962 raft_consensus.cc:348] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.595619 4961 raft_consensus.cc:348] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.595803 4962 raft_consensus.cc:374] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.595830 4961 raft_consensus.cc:374] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.595909 4962 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.595939 4961 raft_consensus.cc:729] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.596211 4961 consensus_queue.cc:260] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.596211 4962 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.596935 4962 ts_tablet_manager.cc:1398] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240501 14:01:55.596963 4961 ts_tablet_manager.cc:1398] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240501 14:01:55.597299 4961 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.597309 4962 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: Bootstrap starting.
I20240501 14:01:55.599247 4961 tablet_bootstrap.cc:654] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.599323 4962 tablet_bootstrap.cc:654] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.602995 4960 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.603340 4960 ts_tablet_manager.cc:1367] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20240501 14:01:55.604427 4973 raft_consensus.cc:482] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.604560 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.604912 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.605227 4919 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.604595 4973 raft_consensus.cc:504] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.606734 4973 leader_election.cc:288] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.607563 4771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.608003 4771 raft_consensus.cc:2454] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 0.
I20240501 14:01:55.604930 4920 raft_consensus.cc:2454] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.609112 4883 leader_election.cc:302] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.609476 4993 raft_consensus.cc:2781] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.609591 4993 raft_consensus.cc:482] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.609720 4993 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.611972 4960 raft_consensus.cc:348] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.612473 4810 leader_election.cc:302] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.613312 4967 raft_consensus.cc:2781] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.613443 4967 raft_consensus.cc:482] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.613550 4967 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.616197 4960 raft_consensus.cc:374] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.616572 4810 leader_election.cc:302] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.616945 4993 raft_consensus.cc:504] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.637156 4967 raft_consensus.cc:504] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.638543 4771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.638849 4771 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.643044 4771 raft_consensus.cc:2454] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 1.
I20240501 14:01:55.643755 4883 leader_election.cc:302] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.644197 4968 raft_consensus.cc:2781] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.645068 4993 leader_election.cc:288] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.648315 4967 leader_election.cc:288] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.648633 4967 raft_consensus.cc:2781] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.648762 4967 raft_consensus.cc:482] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.648873 4967 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.650478 4960 raft_consensus.cc:729] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.651185 4960 consensus_queue.cc:260] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.652565 4960 ts_tablet_manager.cc:1398] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.049s user 0.003s sys 0.000s
I20240501 14:01:55.652968 4960 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: Bootstrap starting.
I20240501 14:01:55.655050 4960 tablet_bootstrap.cc:654] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.657541 4967 raft_consensus.cc:504] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.658878 4962 tablet_bootstrap.cc:492] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: No bootstrap required, opened a new log
I20240501 14:01:55.658804 4967 leader_election.cc:288] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.660280 4962 ts_tablet_manager.cc:1367] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: Time spent bootstrapping tablet: real 0.062s user 0.015s sys 0.040s
I20240501 14:01:55.661327 4962 raft_consensus.cc:348] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.661614 4962 raft_consensus.cc:374] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.661691 4962 raft_consensus.cc:729] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.661943 4962 consensus_queue.cc:260] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.662530 4962 ts_tablet_manager.cc:1398] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20240501 14:01:55.662983 4810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.14.131:43409, user_credentials={real_user=slave}} blocked reactor thread for 47445us
I20240501 14:01:55.668267 4968 raft_consensus.cc:686] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:55.669468 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.669832 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.670851 4920 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.675819 4967 raft_consensus.cc:482] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.678941 4967 raft_consensus.cc:504] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.679397 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.673431 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.673251 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.681250 4846 raft_consensus.cc:2379] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e938bc7d5ae465ba95e6629b014f932 in current term 1: Already voted for candidate 06fa1aefd7694132978f68c92457c6c8 in this term.
I20240501 14:01:55.681372 4771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.681699 4771 raft_consensus.cc:2379] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06fa1aefd7694132978f68c92457c6c8 in current term 1: Already voted for candidate 8e938bc7d5ae465ba95e6629b014f932 in this term.
I20240501 14:01:55.681614 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.681916 4770 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.676587 4968 consensus_queue.cc:237] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.684235 5000 raft_consensus.cc:482] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.686527 4967 leader_election.cc:288] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409), e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559)
I20240501 14:01:55.685423 4768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.687765 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.684648 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.689215 4768 raft_consensus.cc:2379] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06fa1aefd7694132978f68c92457c6c8 in current term 1: Already voted for candidate 8e938bc7d5ae465ba95e6629b014f932 in this term.
I20240501 14:01:55.689270 4769 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.689567 4919 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.690873 4810 leader_election.cc:302] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.691221 4967 raft_consensus.cc:2781] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.691962 4960 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: No bootstrap required, opened a new log
I20240501 14:01:55.692243 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.693506 4770 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.687522 5000 raft_consensus.cc:504] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.694175 4961 tablet_bootstrap.cc:492] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.695361 4967 raft_consensus.cc:482] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.695482 4967 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.696461 4920 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.696659 4999 raft_consensus.cc:482] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.697111 4810 leader_election.cc:302] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.696949 4999 raft_consensus.cc:504] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.697320 4960 ts_tablet_manager.cc:1367] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.008s
I20240501 14:01:55.700824 4961 ts_tablet_manager.cc:1367] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.097s user 0.041s sys 0.030s
I20240501 14:01:55.700958 4809 leader_election.cc:302] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8; no voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:55.701370 5000 leader_election.cc:288] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.702592 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.703186 4999 leader_election.cc:288] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.703723 4999 raft_consensus.cc:2781] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.703815 5004 raft_consensus.cc:2726] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240501 14:01:55.703945 4999 raft_consensus.cc:686] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:55.704416 4999 consensus_queue.cc:237] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.705929 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.706104 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.706313 4846 raft_consensus.cc:2454] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 0.
W20240501 14:01:55.705930 4883 leader_election.cc:341] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:01:55.702072 4666 catalog_manager.cc:5484] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:55.706532 4961 raft_consensus.cc:348] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.708401 4735 leader_election.cc:302] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5e8df89e78d4476a1e647f0316e257e; no voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:01:55.708479 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.710134 4884 leader_election.cc:302] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters: e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:55.710458 4961 raft_consensus.cc:374] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.711403 5000 raft_consensus.cc:2781] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.711053 4960 raft_consensus.cc:348] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.711585 4961 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.711935 4770 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.712357 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.712426 4809 leader_election.cc:302] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.712633 4920 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.712925 5003 raft_consensus.cc:2781] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.713028 5003 raft_consensus.cc:482] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.713191 5003 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.713135 4967 raft_consensus.cc:504] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.714010 4967 leader_election.cc:288] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Requested vote from peers 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409), e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559)
I20240501 14:01:55.714279 5000 raft_consensus.cc:482] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.714329 4960 raft_consensus.cc:374] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.714411 5000 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.714452 4960 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.714768 4960 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.715385 4960 ts_tablet_manager.cc:1398] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20240501 14:01:55.715780 4961 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.716455 4961 ts_tablet_manager.cc:1398] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20240501 14:01:55.717932 4961 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.718006 5000 raft_consensus.cc:504] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.718230 5003 raft_consensus.cc:504] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.719161 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.718834 4667 catalog_manager.cc:5484] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
W20240501 14:01:55.719717 4883 leader_election.cc:341] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:01:55.719858 4769 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.719981 4961 tablet_bootstrap.cc:654] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.720021 4973 raft_consensus.cc:2726] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:01:55.720868 5003 leader_election.cc:288] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.721202 4968 raft_consensus.cc:482] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.721359 4968 raft_consensus.cc:504] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.721561 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.721803 4769 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.722069 4968 leader_election.cc:288] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.722432 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.722638 4770 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 0.
I20240501 14:01:55.723069 4883 leader_election.cc:302] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.723395 4968 raft_consensus.cc:2781] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.723667 4968 raft_consensus.cc:482] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.723765 4968 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.724360 5000 leader_election.cc:288] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.724936 4961 tablet_bootstrap.cc:492] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.725121 4961 ts_tablet_manager.cc:1367] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240501 14:01:55.725085 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.725208 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.725311 4846 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 0.
I20240501 14:01:55.725363 4845 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.726006 4961 raft_consensus.cc:348] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.726238 4961 raft_consensus.cc:374] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.726420 4961 raft_consensus.cc:729] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.726785 4961 consensus_queue.cc:260] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.727144 4968 raft_consensus.cc:504] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.727545 4961 ts_tablet_manager.cc:1398] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 14:01:55.727927 4961 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: Bootstrap starting.
I20240501 14:01:55.728255 4845 raft_consensus.cc:2454] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 1.
I20240501 14:01:55.728461 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.728574 4968 leader_election.cc:288] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:55.728670 4770 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.729277 4884 leader_election.cc:302] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters: e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:55.729532 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.729760 4845 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.729959 4968 raft_consensus.cc:2781] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.730046 4961 tablet_bootstrap.cc:654] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: Neither blocks nor log segments found. Creating new log.
I20240501 14:01:55.730201 4968 raft_consensus.cc:686] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:55.731272 4968 consensus_queue.cc:237] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.732065 4770 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 1.
I20240501 14:01:55.732585 4845 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 1.
I20240501 14:01:55.732772 4883 leader_election.cc:302] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.733121 4993 raft_consensus.cc:2781] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.733295 4993 raft_consensus.cc:686] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:55.733588 4993 consensus_queue.cc:237] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.735618 4667 catalog_manager.cc:5484] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:55.736142 4769 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.736881 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.737112 4770 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.737933 4961 tablet_bootstrap.cc:492] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: No bootstrap required, opened a new log
I20240501 14:01:55.738121 4961 ts_tablet_manager.cc:1367] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20240501 14:01:55.739017 4961 raft_consensus.cc:348] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.739284 4961 raft_consensus.cc:374] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:01:55.739377 4961 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Initialized, Role: FOLLOWER
I20240501 14:01:55.739650 4961 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.740273 4961 ts_tablet_manager.cc:1398] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 14:01:55.740309 4809 leader_election.cc:302] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.740605 5003 raft_consensus.cc:2781] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.740559 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.740913 4920 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.741043 5003 raft_consensus.cc:686] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:55.741477 5003 consensus_queue.cc:237] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:55.741472 4667 catalog_manager.cc:5484] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:55.744122 4920 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.745265 4770 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.745657 4809 leader_election.cc:302] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.745991 4999 raft_consensus.cc:2781] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.746081 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.746140 4999 raft_consensus.cc:686] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:55.745900 4667 catalog_manager.cc:5484] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:55.746261 4920 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.746423 4999 consensus_queue.cc:237] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.749969 4920 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.750873 4667 catalog_manager.cc:5484] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:55.764067 4973 raft_consensus.cc:482] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.764317 4973 raft_consensus.cc:504] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.764983 4973 leader_election.cc:288] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.765556 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.765552 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.765802 4845 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.765861 4920 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.765955 4973 raft_consensus.cc:482] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.766211 4735 leader_election.cc:302] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.766109 4973 raft_consensus.cc:504] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.766517 4966 raft_consensus.cc:2781] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.766630 4966 raft_consensus.cc:482] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.766763 4966 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.766819 4973 leader_election.cc:288] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.767299 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.767499 4920 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.767870 4735 leader_election.cc:302] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.768142 4973 raft_consensus.cc:2781] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.768293 4973 raft_consensus.cc:482] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.768414 4973 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.768457 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.768671 4845 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.769695 4966 raft_consensus.cc:504] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.770442 4966 leader_election.cc:288] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.770826 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.770888 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.771014 4845 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.771086 4920 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.771232 4973 raft_consensus.cc:504] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.771955 4973 leader_election.cc:288] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.772372 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.772588 4846 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.773698 4920 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.774071 4845 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.774127 4735 leader_election.cc:302] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.774415 4973 raft_consensus.cc:2781] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.774600 4973 raft_consensus.cc:686] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:55.774861 4973 consensus_queue.cc:237] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.775333 4846 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.775702 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.775739 4735 leader_election.cc:302] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.775882 4919 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.776353 4966 raft_consensus.cc:2781] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.776564 4966 raft_consensus.cc:686] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:55.776919 4966 consensus_queue.cc:237] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.778883 4919 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.779686 4667 catalog_manager.cc:5484] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 1 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:55.784876 4667 catalog_manager.cc:5484] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 1 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:55.792018 4966 raft_consensus.cc:482] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.792273 4966 raft_consensus.cc:504] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.792970 4966 leader_election.cc:288] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.793334 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:55.793416 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.793568 4846 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.793690 4919 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 0.
I20240501 14:01:55.794008 4735 leader_election.cc:302] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.794253 4966 raft_consensus.cc:2781] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.794379 4966 raft_consensus.cc:482] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.794466 4966 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.796962 4966 raft_consensus.cc:504] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.797621 4966 leader_election.cc:288] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.798138 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.798141 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:55.798416 4919 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.798457 4846 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.801551 4919 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.801551 4846 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 1.
I20240501 14:01:55.802080 4735 leader_election.cc:302] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:55.802400 4966 raft_consensus.cc:2781] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.802551 4966 raft_consensus.cc:686] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:55.802845 4966 consensus_queue.cc:237] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.805722 4667 catalog_manager.cc:5484] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 1 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:55.954035 4999 raft_consensus.cc:482] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:55.954341 4999 raft_consensus.cc:504] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.955305 4999 leader_election.cc:288] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.955963 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:55.956018 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e" is_pre_election: true
I20240501 14:01:55.956234 4919 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.956239 4770 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 0.
I20240501 14:01:55.956671 4810 leader_election.cc:302] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.957140 4999 raft_consensus.cc:2781] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:01:55.957229 4999 raft_consensus.cc:482] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:01:55.957336 4999 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.959335 4999 raft_consensus.cc:504] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.959983 4999 leader_election.cc:288] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:55.960501 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:55.960542 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:55.960731 4770 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.960737 4919 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:55.962914 4770 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.962956 4919 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 1.
I20240501 14:01:55.963438 4810 leader_election.cc:302] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:55.963804 4999 raft_consensus.cc:2781] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:01:55.963960 4999 raft_consensus.cc:686] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:55.964282 4999 consensus_queue.cc:237] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:55.967236 4667 catalog_manager.cc:5484] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.048368 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:01:56.048614 4846 raft_consensus.cc:595] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:56.056077 4919 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:37280
I20240501 14:01:56.056376 4919 raft_consensus.cc:595] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:56.058966 4919 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:37280
I20240501 14:01:56.059298 4919 raft_consensus.cc:595] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:56.061720 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:01:56.061947 4846 raft_consensus.cc:595] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:56.063980 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:01:56.064221 4846 raft_consensus.cc:595] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:01:56.071424 4770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:39180
I20240501 14:01:56.071704 4770 raft_consensus.cc:595] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:01:56.074156 4770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:39180
I20240501 14:01:56.074369 4770 raft_consensus.cc:595] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:01:56.076632 4770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:39180
I20240501 14:01:56.076905 4770 raft_consensus.cc:595] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:01:56.079140 4919 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:37280
I20240501 14:01:56.079352 4919 raft_consensus.cc:595] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:01:56.081976 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:01:56.082190 4846 raft_consensus.cc:595] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Received request to transfer leadership to TS 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:01:56.127032 4999 consensus_queue.cc:1035] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.128101 4993 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.132723 4999 consensus_queue.cc:1035] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.135321 4993 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.137501 4999 raft_consensus.cc:979] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:56.137763 4999 raft_consensus.cc:1067] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Signalling peer 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:56.138990 4919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:37266
I20240501 14:01:56.139174 4968 raft_consensus.cc:979] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.139223 4919 raft_consensus.cc:482] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.139369 4919 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.139348 4968 raft_consensus.cc:1067] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.140060 4846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48228
I20240501 14:01:56.140300 4846 raft_consensus.cc:482] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.140445 4846 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.142499 4919 raft_consensus.cc:504] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.142586 4846 raft_consensus.cc:504] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.143187 4846 leader_election.cc:288] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.143225 4919 leader_election.cc:288] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 2 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:56.143577 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:56.143826 4770 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.143604 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:56.144047 4769 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.144097 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.144158 4966 raft_consensus.cc:482] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:01:56.144316 4919 raft_consensus.cc:3032] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.144424 4919 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:56.144345 4966 raft_consensus.cc:504] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.144870 4919 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.145112 4966 leader_election.cc:288] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.145300 4919 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.145587 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ff5fd428440a9a8dcd7aeb7176e9" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.145850 4846 raft_consensus.cc:3032] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.145975 4846 raft_consensus.cc:729] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.146306 4846 consensus_queue.cc:260] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.146761 4846 raft_consensus.cc:3037] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.146992 4769 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.147051 4770 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 2.
I20240501 14:01:56.147621 4883 leader_election.cc:302] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.147939 4968 raft_consensus.cc:2781] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.148106 4968 raft_consensus.cc:686] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:56.148193 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fa1aefd7694132978f68c92457c6c8" is_pre_election: true
I20240501 14:01:56.148263 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e938bc7d5ae465ba95e6629b014f932" is_pre_election: true
I20240501 14:01:56.148447 4845 raft_consensus.cc:2379] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5e8df89e78d4476a1e647f0316e257e in current term 1: Already voted for candidate 8e938bc7d5ae465ba95e6629b014f932 in this term.
I20240501 14:01:56.147909 4809 leader_election.cc:302] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.148471 4968 consensus_queue.cc:237] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.148887 5004 raft_consensus.cc:2781] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.149040 5004 raft_consensus.cc:686] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.149308 5004 consensus_queue.cc:237] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.149507 4919 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.150429 4735 leader_election.cc:302] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5e8df89e78d4476a1e647f0316e257e; no voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:01:56.150777 4966 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:01:56.150884 4846 raft_consensus.cc:2454] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 2.
I20240501 14:01:56.152088 4667 catalog_manager.cc:5484] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 1 to 2, leader changed from 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.153316 4966 raft_consensus.cc:2726] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:01:56.153082 4666 catalog_manager.cc:5484] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 1 to 2, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 2 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:56.174580 4967 consensus_queue.cc:1035] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.177780 5004 raft_consensus.cc:979] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.177971 5004 raft_consensus.cc:1067] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.179409 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:01:56.179672 4770 raft_consensus.cc:482] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.179819 4770 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.180116 4967 consensus_queue.cc:1035] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.182593 4770 raft_consensus.cc:504] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.183353 4770 leader_election.cc:288] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.183830 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.183808 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0567d1ca9b624fe9980db88a3fed0d74" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.184046 4919 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.184238 4846 raft_consensus.cc:3032] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.184389 4846 raft_consensus.cc:729] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.184700 4846 consensus_queue.cc:260] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.185094 4846 raft_consensus.cc:3037] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.186749 5004 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.187240 4919 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.187670 4735 leader_election.cc:302] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.187914 4846 raft_consensus.cc:2454] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.187991 4966 raft_consensus.cc:2781] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.188133 4966 raft_consensus.cc:686] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.188477 4966 consensus_queue.cc:237] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.191124 4667 catalog_manager.cc:5484] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 1 to 2, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 2 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.201076 4999 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.204272 5004 raft_consensus.cc:979] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.204452 4999 raft_consensus.cc:1067] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.205106 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:01:56.205365 4770 raft_consensus.cc:482] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.205508 4770 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.207723 4770 raft_consensus.cc:504] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:56.208536 4770 leader_election.cc:288] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Requested vote from peers 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:56.209048 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.209134 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.209304 4920 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.209349 4846 raft_consensus.cc:3032] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.209434 4846 raft_consensus.cc:729] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.209726 4846 consensus_queue.cc:260] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:56.210114 4846 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.212548 4920 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.213024 4735 leader_election.cc:302] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.213052 4846 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.213449 4966 raft_consensus.cc:2781] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.213631 4966 raft_consensus.cc:686] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.213969 4966 consensus_queue.cc:237] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:01:56.216430 4666 catalog_manager.cc:5484] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 1 to 2, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 2 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:56.235272 4968 consensus_queue.cc:1035] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.237589 4966 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.241369 4993 consensus_queue.cc:1035] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.242199 5013 raft_consensus.cc:979] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.242405 4973 raft_consensus.cc:1067] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.244357 4846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48242
I20240501 14:01:56.244582 4846 raft_consensus.cc:482] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.244719 4846 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.245090 4966 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.247946 4846 raft_consensus.cc:504] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.248680 4846 leader_election.cc:288] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.249562 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:56.249668 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.249831 4769 raft_consensus.cc:3032] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.249873 4920 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.249925 4769 raft_consensus.cc:729] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.250226 4769 consensus_queue.cc:260] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.250660 4769 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.252435 4993 raft_consensus.cc:979] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.252594 4993 raft_consensus.cc:1067] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.253552 4769 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.253680 5031 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.254206 4920 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.254245 4809 leader_election.cc:302] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.254535 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39156
I20240501 14:01:56.254751 4999 raft_consensus.cc:2781] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.254935 4999 raft_consensus.cc:686] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.255251 4999 consensus_queue.cc:237] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.254746 4770 raft_consensus.cc:482] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.256398 4770 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.257107 4966 raft_consensus.cc:979] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.257251 4966 raft_consensus.cc:1067] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.258117 4845 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48242
I20240501 14:01:56.258363 4845 raft_consensus.cc:482] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.258486 4845 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.258790 4666 catalog_manager.cc:5484] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 1 to 2, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.259721 4770 raft_consensus.cc:504] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.260825 4844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.261124 4844 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.261085 4845 raft_consensus.cc:504] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.261327 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9563bc227c4ddf9496cc255ba39ef9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.261572 4919 raft_consensus.cc:3032] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.261967 4919 raft_consensus.cc:729] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:56.262398 4845 leader_election.cc:288] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.263608 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:56.263945 4846 raft_consensus.cc:1226] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Rejecting Update request from peer e5e8df89e78d4476a1e647f0316e257e for earlier term 1. Current term is 2. Ops: []
I20240501 14:01:56.264464 4919 consensus_queue.cc:260] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.264818 4919 raft_consensus.cc:3037] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.265659 4844 raft_consensus.cc:2454] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.266068 4735 leader_election.cc:302] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.266366 5031 raft_consensus.cc:2781] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.266520 5031 raft_consensus.cc:686] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.266789 5031 consensus_queue.cc:237] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.267180 4919 raft_consensus.cc:2454] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.267405 4918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.267638 4918 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.268225 5031 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.268307 4966 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240501 14:01:56.269076 4770 leader_election.cc:288] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.270529 4918 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.271016 4810 leader_election.cc:302] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:56.271358 4999 raft_consensus.cc:2781] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.271400 5013 consensus_queue.cc:1046] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.271540 4999 raft_consensus.cc:686] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.271854 4999 consensus_queue.cc:237] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.273546 4966 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.274897 4667 catalog_manager.cc:5484] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 1 to 2, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.276580 4973 raft_consensus.cc:979] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.276772 4973 raft_consensus.cc:1067] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:01:56.277133 4919 raft_consensus.cc:1226] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Rejecting Update request from peer e5e8df89e78d4476a1e647f0316e257e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20240501 14:01:56.277470 4844 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48242
I20240501 14:01:56.277701 4844 raft_consensus.cc:482] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.277796 4769 raft_consensus.cc:3032] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.277824 4844 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.277756 4966 consensus_queue.cc:1046] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.277879 4769 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.278156 4769 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.278476 4769 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.280076 4844 raft_consensus.cc:504] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.280436 4769 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
W20240501 14:01:56.280639 5013 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20240501 14:01:56.281167 4844 leader_election.cc:288] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.281512 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:56.281774 4770 raft_consensus.cc:3032] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.281883 4770 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.281842 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.282202 4770 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.282500 4919 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.282582 4770 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.283977 4667 catalog_manager.cc:5484] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 1 to 2, leader changed from 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 2 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.285627 4770 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.285651 4919 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 2.
I20240501 14:01:56.286098 4810 leader_election.cc:302] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:56.286373 4999 raft_consensus.cc:2781] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.286517 4999 raft_consensus.cc:686] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.286783 4999 consensus_queue.cc:237] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.289242 4666 catalog_manager.cc:5484] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 1 to 2, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 2 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.314229 4968 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.317600 4993 raft_consensus.cc:979] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.317648 5000 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.318563 4993 raft_consensus.cc:1067] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.320842 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39156
I20240501 14:01:56.321102 4770 raft_consensus.cc:482] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.321223 4770 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.323873 4770 raft_consensus.cc:504] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.324627 4770 leader_election.cc:288] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.325371 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.325608 4919 raft_consensus.cc:3032] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.325718 4919 raft_consensus.cc:729] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:56.325613 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.326061 4919 consensus_queue.cc:260] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.326370 4919 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.328681 4919 raft_consensus.cc:2454] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.329083 4735 leader_election.cc:302] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters: 06fa1aefd7694132978f68c92457c6c8
I20240501 14:01:56.329389 5013 raft_consensus.cc:2781] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.329545 5013 raft_consensus.cc:686] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.329869 5013 consensus_queue.cc:237] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.332381 4667 catalog_manager.cc:5484] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 1 to 2, leader changed from 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 2 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.480614 5004 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.484946 5004 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.488096 4967 raft_consensus.cc:979] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.488297 4967 raft_consensus.cc:1067] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:01:56.488909 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:01:56.489084 4770 raft_consensus.cc:482] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:56.489235 4770 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.491520 4770 raft_consensus.cc:504] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.492077 4770 leader_election.cc:288] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:01:56.492558 4844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:56.492578 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:01:56.492812 4844 raft_consensus.cc:3032] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 14:01:56.492889 4919 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.492928 4844 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:56.493197 4844 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.493563 4844 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.495091 4919 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.495519 4735 leader_election.cc:302] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:56.495606 4844 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 2.
I20240501 14:01:56.495836 5013 raft_consensus.cc:2781] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:01:56.495996 5013 raft_consensus.cc:686] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:56.496311 5013 consensus_queue.cc:237] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:56.498551 4666 catalog_manager.cc:5484] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 1 to 2, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 2 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:01:56.552388 4770 raft_consensus.cc:1261] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.553025 5039 consensus_queue.cc:1035] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.556644 4844 raft_consensus.cc:1261] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.557225 5039 consensus_queue.cc:1035] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.569955 4919 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.570559 4967 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.573801 4770 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.574381 4999 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.593940 4844 raft_consensus.cc:1261] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.594588 5013 consensus_queue.cc:1035] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.598397 4919 raft_consensus.cc:1261] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.598969 4973 consensus_queue.cc:1035] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.648428 4919 raft_consensus.cc:1261] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.649134 4973 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.652694 4844 raft_consensus.cc:1261] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.653230 4966 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.677608 4770 raft_consensus.cc:1261] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.678272 4999 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.681710 4919 raft_consensus.cc:1261] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.682389 4967 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.698729 4919 raft_consensus.cc:1261] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.699357 4966 consensus_queue.cc:1035] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.702267 4844 raft_consensus.cc:1261] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.702950 5013 consensus_queue.cc:1035] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.762631 4844 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:01:56.765045 4844 raft_consensus.cc:1261] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.765816 5013 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.768918 4919 raft_consensus.cc:1261] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.769733 4966 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.849742 4919 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.850395 4967 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:01:56.854867 4770 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.855551 4967 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.858927 4770 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.859573 4967 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:56.863104 4919 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:56.863698 5003 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:57.029487 4919 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:57.030084 5013 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:57.033311 4844 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 14:01:57.034247 4966 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:01:59.094200 4154 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240501 14:01:59.094453 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:01:59.107214 4770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:39196
I20240501 14:01:59.107473 4770 raft_consensus.cc:595] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Received request to transfer leadership to TS 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:01:59.113716 4844 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:48274
I20240501 14:01:59.113936 4844 raft_consensus.cc:595] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Received request to transfer leadership to TS 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:01:59.114465 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 14:01:59.114687 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:01:59.169203 4966 raft_consensus.cc:979] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:59.169375 4966 raft_consensus.cc:1067] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Signalling peer 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:59.169999 4920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:37276
I20240501 14:01:59.170220 4920 raft_consensus.cc:482] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:59.170323 4920 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.173571 4920 raft_consensus.cc:504] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.174177 4920 leader_election.cc:288] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:59.174662 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:59.174664 4844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:59.174847 4770 raft_consensus.cc:3032] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:59.174903 4844 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.174957 4770 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:01:59.175205 4770 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.175529 4770 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.177188 4844 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:01:59.177632 4770 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:01:59.177788 4884 leader_election.cc:302] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:01:59.178098 5044 raft_consensus.cc:2781] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:59.178545 5044 raft_consensus.cc:686] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:59.178907 5044 consensus_queue.cc:237] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.181602 4667 catalog_manager.cc:5484] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 2 to 3, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:59.203368 5045 raft_consensus.cc:979] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:59.203538 5045 raft_consensus.cc:1067] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Signalling peer 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:01:59.204326 4920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:37266
I20240501 14:01:59.204533 4920 raft_consensus.cc:482] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:01:59.204639 4920 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.206513 4920 raft_consensus.cc:504] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.207132 4920 leader_election.cc:288] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:01:59.207590 4770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:01:59.207625 4844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:01:59.207763 4770 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.207824 4844 raft_consensus.cc:3032] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:01:59.207938 4844 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:01:59.208217 4844 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.208635 4844 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:01:59.210031 4770 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:01:59.210439 4883 leader_election.cc:302] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:01:59.210734 5044 raft_consensus.cc:2781] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:01:59.210772 4844 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:01:59.210884 5044 raft_consensus.cc:686] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:01:59.211179 5044 consensus_queue.cc:237] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:01:59.214038 4667 catalog_manager.cc:5484] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 2 to 3, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:01:59.589114 4844 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:59.589701 5044 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:59.594978 4770 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:59.595906 5061 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:59.797533 4770 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:59.798207 5061 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:01:59.802009 4844 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:01:59.802596 5050 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:00.115142 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:00.117002 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:00.117201 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:01.117587 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:01.119308 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:01.119498 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:02.120026 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:02.121824 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:02.122067 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:03.122567 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:03.124557 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:03.124781 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:04.125381 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:04.127182 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:04.127415 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:05.127910 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:05.129799 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:05.130009 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:06.130506 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:06.132500 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:06.132761 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:07.133487 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:07.135771 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:07.136051 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:08.136548 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:08.138661 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:08.138912 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:09.151458 4154 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240501 14:02:09.157855 4920 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:37280
I20240501 14:02:09.158093 4920 raft_consensus.cc:595] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:02:09.160367 4844 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:02:09.160607 4844 raft_consensus.cc:595] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:02:09.162842 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:02:09.163079 4846 raft_consensus.cc:595] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:02:09.165107 4846 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
mode: GRACEFUL
new_leader_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:48258
I20240501 14:02:09.165292 4846 raft_consensus.cc:595] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Received request to transfer leadership to TS e5e8df89e78d4476a1e647f0316e257e
I20240501 14:02:09.167259 4920 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:37280
I20240501 14:02:09.167457 4920 raft_consensus.cc:595] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:02:09.233899 5070 raft_consensus.cc:979] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:09.234088 5070 raft_consensus.cc:1067] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:09.234838 4846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48228
I20240501 14:02:09.235074 4846 raft_consensus.cc:482] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:09.235203 4846 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.237737 4846 raft_consensus.cc:504] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.238478 4846 leader_election.cc:288] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 4 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:09.238996 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:09.239002 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1bc10ded8847ef9b5b01d414cd2bd2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:02:09.239259 4920 raft_consensus.cc:3032] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:02:09.239306 4769 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.239362 4920 raft_consensus.cc:729] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:02:09.239670 4920 consensus_queue.cc:260] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.240005 4920 raft_consensus.cc:3037] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.241595 4769 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 4.
I20240501 14:02:09.242082 4809 leader_election.cc:302] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:02:09.242106 4920 raft_consensus.cc:2454] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 4.
I20240501 14:02:09.242408 5064 raft_consensus.cc:2781] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:02:09.242848 5064 raft_consensus.cc:686] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:09.243193 5064 consensus_queue.cc:237] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.245889 4666 catalog_manager.cc:5484] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 3 to 4, leader changed from 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 4 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:09.353094 5069 raft_consensus.cc:979] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.353276 5069 raft_consensus.cc:1067] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.354189 4769 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17f94681048a4627857a0e4907aee34f"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39156
I20240501 14:02:09.354409 4769 raft_consensus.cc:482] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:09.354537 4769 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.356623 4769 raft_consensus.cc:504] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.357321 4769 leader_election.cc:288] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 4 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:09.357975 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:09.357959 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f94681048a4627857a0e4907aee34f" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:09.358232 4920 raft_consensus.cc:3032] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:02:09.358268 4846 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.358338 4920 raft_consensus.cc:729] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:02:09.358669 4920 consensus_queue.cc:260] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.359058 4920 raft_consensus.cc:3037] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:09.361451 4846 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 4.
I20240501 14:02:09.361802 4920 raft_consensus.cc:2454] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 4.
I20240501 14:02:09.362133 4735 leader_election.cc:302] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:02:09.362481 5068 raft_consensus.cc:2781] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:02:09.362968 5068 raft_consensus.cc:686] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 4 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:09.363289 5068 consensus_queue.cc:237] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.366044 4666 catalog_manager.cc:5484] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 3 to 4, leader changed from 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 4 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:09.406857 5071 raft_consensus.cc:979] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.407023 5071 raft_consensus.cc:1067] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.407809 4769 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:02:09.408028 4769 raft_consensus.cc:482] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:09.408120 4769 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.410216 4769 raft_consensus.cc:504] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.410835 4769 leader_election.cc:288] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:09.411660 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:09.411808 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:09.411891 4920 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.411998 4846 raft_consensus.cc:3032] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:02:09.412132 4846 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:09.412437 4846 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.412811 4846 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.414250 4920 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.414840 4735 leader_election.cc:302] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:02:09.414948 4846 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.415277 5068 raft_consensus.cc:2781] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:02:09.415433 5068 raft_consensus.cc:686] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:09.415696 5068 consensus_queue.cc:237] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.419035 4666 catalog_manager.cc:5484] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 2 to 3, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 3 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:09.501175 5064 raft_consensus.cc:979] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.501377 5064 raft_consensus.cc:1067] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.502085 4769 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:02:09.502279 4769 raft_consensus.cc:482] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:09.502415 4769 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.504554 4769 raft_consensus.cc:504] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.505177 4769 leader_election.cc:288] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:09.505717 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:09.505678 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "257d757fec9e48e187ce34614eba5ece" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:09.505909 4920 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.505906 4846 raft_consensus.cc:3032] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:02:09.506043 4846 raft_consensus.cc:729] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:09.506335 4846 consensus_queue.cc:260] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.506752 4846 raft_consensus.cc:3037] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.509027 4920 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.509707 4846 raft_consensus.cc:2454] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.509784 4735 leader_election.cc:302] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:02:09.510087 5068 raft_consensus.cc:2781] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:02:09.510612 5068 raft_consensus.cc:686] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:09.510901 5068 consensus_queue.cc:237] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.513423 4666 catalog_manager.cc:5484] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 2 to 3, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 3 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:09.743171 5071 raft_consensus.cc:979] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: : Instructing follower e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.743369 5071 raft_consensus.cc:1067] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Signalling peer e5e8df89e78d4476a1e647f0316e257e to start an election
I20240501 14:02:09.744002 4769 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
from {username='slave'} at 127.0.0.1:39164
I20240501 14:02:09.744261 4769 raft_consensus.cc:482] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:09.744370 4769 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.746371 4769 raft_consensus.cc:504] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.746971 4769 leader_election.cc:288] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:09.747632 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:09.747627 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "e5e8df89e78d4476a1e647f0316e257e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:09.747900 4920 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.747896 4846 raft_consensus.cc:3032] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:02:09.748059 4846 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:09.748353 4846 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.748762 4846 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:09.751044 4920 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.751485 4846 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e8df89e78d4476a1e647f0316e257e in term 3.
I20240501 14:02:09.751585 4735 leader_election.cc:302] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e938bc7d5ae465ba95e6629b014f932, e5e8df89e78d4476a1e647f0316e257e; no voters:
I20240501 14:02:09.751929 5068 raft_consensus.cc:2781] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:02:09.752102 5068 raft_consensus.cc:686] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Becoming Leader. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:09.752384 5068 consensus_queue.cc:237] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:09.755093 4666 catalog_manager.cc:5484] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e reported cstate change: term changed from 2 to 3, leader changed from 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130) to e5e8df89e78d4476a1e647f0316e257e (127.4.14.129). New cstate: current_term: 3 leader_uuid: "e5e8df89e78d4476a1e647f0316e257e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:09.809629 4920 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:09.810376 5071 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:09.815347 4769 raft_consensus.cc:1261] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:09.816074 5071 consensus_queue.cc:1035] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:09.898950 4920 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:09.899633 5068 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:09.903141 4846 raft_consensus.cc:1261] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:09.903898 5068 consensus_queue.cc:1035] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:09.937830 4920 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:09.938457 5068 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:09.942354 4846 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:09.942898 5077 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:09.947790 4920 raft_consensus.cc:1261] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:09.948354 5068 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:09.951961 4846 raft_consensus.cc:1261] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:09.952558 5068 consensus_queue.cc:1035] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:10.259763 4846 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:10.260423 5068 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:10.264539 4920 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Refusing update from remote peer e5e8df89e78d4476a1e647f0316e257e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:10.265374 5080 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:12.185688 4154 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240501 14:02:12.185988 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:12.188827 4769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:39196
I20240501 14:02:12.189210 4769 raft_consensus.cc:595] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Received request to transfer leadership to TS 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:02:12.190863 4769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:39196
I20240501 14:02:12.191169 4769 raft_consensus.cc:595] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:02:12.192454 4769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:39196
I20240501 14:02:12.192747 4769 raft_consensus.cc:595] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Received request to transfer leadership to TS 06fa1aefd7694132978f68c92457c6c8
I20240501 14:02:12.193919 4769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db"
dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
mode: GRACEFUL
new_leader_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:39196
I20240501 14:02:12.194447 4769 raft_consensus.cc:595] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Received request to transfer leadership to TS 8e938bc7d5ae465ba95e6629b014f932
I20240501 14:02:12.195071 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240501 14:02:12.195359 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:12.290753 5096 raft_consensus.cc:979] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:12.290982 5096 raft_consensus.cc:1067] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:12.291688 4846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48242
I20240501 14:02:12.291936 4846 raft_consensus.cc:482] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:12.292061 4846 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.294641 4846 raft_consensus.cc:504] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.295570 4846 leader_election.cc:288] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 3 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:12.296073 4920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:12.296074 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac72552c32424e48a5dcef5e877c67e9" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:02:12.296391 4920 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.296465 4769 raft_consensus.cc:3032] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:02:12.296571 4769 raft_consensus.cc:729] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:12.296895 4769 consensus_queue.cc:260] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.297224 4769 raft_consensus.cc:3037] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.298887 4920 raft_consensus.cc:2454] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 3.
I20240501 14:02:12.299226 4769 raft_consensus.cc:2454] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 3.
I20240501 14:02:12.299413 4810 leader_election.cc:302] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:02:12.299779 5085 raft_consensus.cc:2781] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:02:12.300235 5085 raft_consensus.cc:686] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 3 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:12.300591 5085 consensus_queue.cc:237] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.303422 4667 catalog_manager.cc:5484] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 2 to 3, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 3 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:12.308207 5098 raft_consensus.cc:979] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:02:12.308408 5096 raft_consensus.cc:1067] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Signalling peer 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:02:12.309007 4920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "128abbd925d64626b0414eb35011b25a"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:37276
I20240501 14:02:12.309176 4920 raft_consensus.cc:482] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:12.309280 4920 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.311344 4920 raft_consensus.cc:504] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.312413 4920 leader_election.cc:288] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 4 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239)
I20240501 14:02:12.312664 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:12.312901 4846 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.314872 4846 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 4.
I20240501 14:02:12.315364 4884 leader_election.cc:302] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:02:12.315459 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "128abbd925d64626b0414eb35011b25a" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:02:12.315683 5069 raft_consensus.cc:2781] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:02:12.315724 4769 raft_consensus.cc:3032] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:02:12.315862 4769 raft_consensus.cc:729] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:12.316141 4769 consensus_queue.cc:260] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.316301 5069 raft_consensus.cc:686] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 4 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:02:12.316537 4769 raft_consensus.cc:3037] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.316624 5069 consensus_queue.cc:237] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.319021 4769 raft_consensus.cc:2454] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 4.
I20240501 14:02:12.319511 4667 catalog_manager.cc:5484] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 3 to 4, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 4 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:12.463284 5098 raft_consensus.cc:979] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:12.463490 5098 raft_consensus.cc:1067] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Signalling peer 06fa1aefd7694132978f68c92457c6c8 to start an election
I20240501 14:02:12.464282 4846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2"
dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
from {username='slave'} at 127.0.0.1:48242
I20240501 14:02:12.464484 4846 raft_consensus.cc:482] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:12.464609 4846 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.466658 4846 raft_consensus.cc:504] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.467415 4846 leader_election.cc:288] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 4 election: Requested vote from peers e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559), 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131:43409)
I20240501 14:02:12.467974 4919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
I20240501 14:02:12.467973 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319d402878654a8fbfc5014a478c6ca2" candidate_uuid: "06fa1aefd7694132978f68c92457c6c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:02:12.468314 4919 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.468346 4769 raft_consensus.cc:3032] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Stepping down as leader of term 3
I20240501 14:02:12.468501 4769 raft_consensus.cc:729] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:12.468835 4769 consensus_queue.cc:260] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.469166 4769 raft_consensus.cc:3037] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:02:12.470755 4919 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 4.
I20240501 14:02:12.471191 4810 leader_election.cc:302] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:02:12.471239 4769 raft_consensus.cc:2454] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fa1aefd7694132978f68c92457c6c8 in term 4.
I20240501 14:02:12.471490 5085 raft_consensus.cc:2781] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:02:12.471683 5085 raft_consensus.cc:686] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 LEADER]: Becoming Leader. State: Replica: 06fa1aefd7694132978f68c92457c6c8, State: Running, Role: LEADER
I20240501 14:02:12.471994 5085 consensus_queue.cc:237] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } }
I20240501 14:02:12.474615 4667 catalog_manager.cc:5484] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 reported cstate change: term changed from 3 to 4, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130). New cstate: current_term: 4 leader_uuid: "06fa1aefd7694132978f68c92457c6c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:12.611901 5098 raft_consensus.cc:979] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: : Instructing follower 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:02:12.612092 5098 raft_consensus.cc:1067] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Signalling peer 8e938bc7d5ae465ba95e6629b014f932 to start an election
I20240501 14:02:12.612787 4919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db"
dest_uuid: "8e938bc7d5ae465ba95e6629b014f932"
from {username='slave'} at 127.0.0.1:37276
I20240501 14:02:12.613008 4919 raft_consensus.cc:482] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 14:02:12.613138 4919 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.615197 4919 raft_consensus.cc:504] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:02:12.615921 4919 leader_election.cc:288] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Requested vote from peers 06fa1aefd7694132978f68c92457c6c8 (127.4.14.130:34239), e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559)
I20240501 14:02:12.616549 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fa1aefd7694132978f68c92457c6c8"
I20240501 14:02:12.616729 4769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7501d8c96924fa19f4045735bd261db" candidate_uuid: "8e938bc7d5ae465ba95e6629b014f932" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5e8df89e78d4476a1e647f0316e257e"
I20240501 14:02:12.616847 4846 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.616910 4769 raft_consensus.cc:3032] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 14:02:12.616994 4769 raft_consensus.cc:729] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5e8df89e78d4476a1e647f0316e257e, State: Running, Role: LEADER
I20240501 14:02:12.617321 4769 consensus_queue.cc:260] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:02:12.617740 4769 raft_consensus.cc:3037] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Advancing to term 3
I20240501 14:02:12.620051 4846 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:02:12.620580 4769 raft_consensus.cc:2454] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e938bc7d5ae465ba95e6629b014f932 in term 3.
I20240501 14:02:12.620716 4884 leader_election.cc:302] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fa1aefd7694132978f68c92457c6c8, 8e938bc7d5ae465ba95e6629b014f932; no voters:
I20240501 14:02:12.621053 5069 raft_consensus.cc:2781] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:02:12.621202 5069 raft_consensus.cc:686] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Becoming Leader. State: Replica: 8e938bc7d5ae465ba95e6629b014f932, State: Running, Role: LEADER
I20240501 14:02:12.621507 5069 consensus_queue.cc:237] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } }
I20240501 14:02:12.624152 4667 catalog_manager.cc:5484] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 reported cstate change: term changed from 2 to 3, leader changed from e5e8df89e78d4476a1e647f0316e257e (127.4.14.129) to 8e938bc7d5ae465ba95e6629b014f932 (127.4.14.131). New cstate: current_term: 3 leader_uuid: "8e938bc7d5ae465ba95e6629b014f932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:12.750905 4920 raft_consensus.cc:1261] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:12.751504 5099 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:12.755996 4769 raft_consensus.cc:1261] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:12.756598 5099 consensus_queue.cc:1035] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:12.786703 4846 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:12.787355 5069 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:12.791419 4769 raft_consensus.cc:1261] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:12.792294 5115 consensus_queue.cc:1035] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:12.971443 4769 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:12.972049 5099 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:12.976058 4920 raft_consensus.cc:1261] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Refusing update from remote peer 06fa1aefd7694132978f68c92457c6c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 14:02:12.976791 5099 consensus_queue.cc:1035] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e938bc7d5ae465ba95e6629b014f932" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:13.030949 4846 raft_consensus.cc:1261] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:13.031561 5115 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fa1aefd7694132978f68c92457c6c8" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:13.036231 4769 raft_consensus.cc:1261] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Refusing update from remote peer 8e938bc7d5ae465ba95e6629b014f932: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 14:02:13.036899 5115 consensus_queue.cc:1035] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e8df89e78d4476a1e647f0316e257e" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:13.196007 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:13.198239 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:13.198488 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:14.198961 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:14.200702 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:14.200922 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:15.201431 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:15.203238 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:15.203465 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:16.203912 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:16.205767 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:16.205973 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:17.206542 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:17.208390 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:17.208642 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:18.218251 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:18.220250 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:18.220434 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:19.220935 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:19.222761 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:19.222975 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:20.223423 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:20.225426 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:20.225639 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:21.226123 4154 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 14:02:21.228621 4154 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 14:02:21.228857 4154 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 14:02:22.240608 4154 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240501 14:02:22.240826 4154 tablet_server.cc:178] TabletServer@127.4.14.129:0 shutting down...
I20240501 14:02:22.261657 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:02:22.261950 4154 tablet_replica.cc:330] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.262125 4154 raft_consensus.cc:2229] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.262313 4154 raft_consensus.cc:2258] T 319d402878654a8fbfc5014a478c6ca2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.262892 4154 tablet_replica.cc:330] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.263031 4154 raft_consensus.cc:2229] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.263288 4154 raft_consensus.cc:2258] T 17f94681048a4627857a0e4907aee34f P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.263741 4154 tablet_replica.cc:330] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.263868 4154 raft_consensus.cc:2229] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.263994 4154 raft_consensus.cc:2258] T ac72552c32424e48a5dcef5e877c67e9 P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.264449 4154 tablet_replica.cc:330] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.264572 4154 raft_consensus.cc:2229] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.264690 4154 raft_consensus.cc:2258] T e7501d8c96924fa19f4045735bd261db P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.265084 4154 tablet_replica.cc:330] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.265203 4154 raft_consensus.cc:2229] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.265322 4154 raft_consensus.cc:2258] T cd53ff5fd428440a9a8dcd7aeb7176e9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.265724 4154 tablet_replica.cc:330] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.265841 4154 raft_consensus.cc:2229] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.265976 4154 raft_consensus.cc:2258] T 128abbd925d64626b0414eb35011b25a P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.266366 4154 tablet_replica.cc:330] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.266487 4154 raft_consensus.cc:2229] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.266731 4154 raft_consensus.cc:2258] T 0567d1ca9b624fe9980db88a3fed0d74 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.267109 4154 tablet_replica.cc:330] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.267230 4154 raft_consensus.cc:2229] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.267364 4154 raft_consensus.cc:2258] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P e5e8df89e78d4476a1e647f0316e257e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.267814 4154 tablet_replica.cc:330] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.267935 4154 raft_consensus.cc:2229] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 3 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.268162 4154 raft_consensus.cc:2258] T 257d757fec9e48e187ce34614eba5ece P e5e8df89e78d4476a1e647f0316e257e [term 3 FOLLOWER]: Raft consensus is shut down!
W20240501 14:02:22.268304 4883 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20240501 14:02:22.268611 4154 tablet_replica.cc:330] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e: stopping tablet replica
I20240501 14:02:22.268740 4154 raft_consensus.cc:2229] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 2 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.268956 4154 raft_consensus.cc:2258] T 9d9563bc227c4ddf9496cc255ba39ef9 P e5e8df89e78d4476a1e647f0316e257e [term 2 FOLLOWER]: Raft consensus is shut down!
W20240501 14:02:22.269425 4883 consensus_peers.cc:485] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 -> Peer e5e8df89e78d4476a1e647f0316e257e (127.4.14.129:34559): Couldn't send request to peer e5e8df89e78d4476a1e647f0316e257e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:22.284688 4154 tablet_server.cc:194] TabletServer@127.4.14.129:0 shutdown complete.
I20240501 14:02:22.289281 4154 tablet_server.cc:178] TabletServer@127.4.14.130:0 shutting down...
I20240501 14:02:22.298924 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:02:22.299175 4154 tablet_replica.cc:330] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.299355 4154 raft_consensus.cc:2229] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.299539 4154 raft_consensus.cc:2258] T 257d757fec9e48e187ce34614eba5ece P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.300129 4154 tablet_replica.cc:330] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.300285 4154 raft_consensus.cc:2229] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.300423 4154 raft_consensus.cc:2258] T 17f94681048a4627857a0e4907aee34f P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.300832 4154 tablet_replica.cc:330] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.300945 4154 raft_consensus.cc:2229] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.301182 4154 raft_consensus.cc:2258] T 319d402878654a8fbfc5014a478c6ca2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.301574 4154 tablet_replica.cc:330] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.301690 4154 raft_consensus.cc:2229] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.301795 4154 raft_consensus.cc:2258] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.302155 4154 tablet_replica.cc:330] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.302253 4154 raft_consensus.cc:2229] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.302359 4154 raft_consensus.cc:2258] T 128abbd925d64626b0414eb35011b25a P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.302700 4154 tablet_replica.cc:330] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.302795 4154 raft_consensus.cc:2229] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.303036 4154 raft_consensus.cc:2258] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 06fa1aefd7694132978f68c92457c6c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.303400 4154 tablet_replica.cc:330] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.303494 4154 raft_consensus.cc:2229] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.303592 4154 raft_consensus.cc:2258] T 0567d1ca9b624fe9980db88a3fed0d74 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.303942 4154 tablet_replica.cc:330] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.304036 4154 raft_consensus.cc:2229] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.304131 4154 raft_consensus.cc:2258] T 9d9563bc227c4ddf9496cc255ba39ef9 P 06fa1aefd7694132978f68c92457c6c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.304550 4154 tablet_replica.cc:330] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.304652 4154 raft_consensus.cc:2229] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.304754 4154 raft_consensus.cc:2258] T e7501d8c96924fa19f4045735bd261db P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.305092 4154 tablet_replica.cc:330] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8: stopping tablet replica
I20240501 14:02:22.305178 4154 raft_consensus.cc:2229] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 3 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.305424 4154 raft_consensus.cc:2258] T ac72552c32424e48a5dcef5e877c67e9 P 06fa1aefd7694132978f68c92457c6c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.320850 4154 tablet_server.cc:194] TabletServer@127.4.14.130:0 shutdown complete.
I20240501 14:02:22.325297 4154 tablet_server.cc:178] TabletServer@127.4.14.131:0 shutting down...
I20240501 14:02:22.339424 4154 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 14:02:22.339892 4154 tablet_replica.cc:330] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.340057 4154 raft_consensus.cc:2229] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.340271 4154 raft_consensus.cc:2258] T 17f94681048a4627857a0e4907aee34f P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.340817 4154 tablet_replica.cc:330] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.340929 4154 raft_consensus.cc:2229] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.341054 4154 raft_consensus.cc:2258] T 257d757fec9e48e187ce34614eba5ece P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.341429 4154 tablet_replica.cc:330] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.341529 4154 raft_consensus.cc:2229] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.341631 4154 raft_consensus.cc:2258] T 319d402878654a8fbfc5014a478c6ca2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.341995 4154 tablet_replica.cc:330] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.342092 4154 raft_consensus.cc:2229] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.342190 4154 raft_consensus.cc:2258] T 9d9563bc227c4ddf9496cc255ba39ef9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.342543 4154 tablet_replica.cc:330] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.342640 4154 raft_consensus.cc:2229] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 4 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.342867 4154 raft_consensus.cc:2258] T 128abbd925d64626b0414eb35011b25a P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.343230 4154 tablet_replica.cc:330] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.343326 4154 raft_consensus.cc:2229] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.343421 4154 raft_consensus.cc:2258] T 3d1bc10ded8847ef9b5b01d414cd2bd2 P 8e938bc7d5ae465ba95e6629b014f932 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.343755 4154 tablet_replica.cc:330] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.343847 4154 raft_consensus.cc:2229] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.343951 4154 raft_consensus.cc:2258] T 0567d1ca9b624fe9980db88a3fed0d74 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.344331 4154 tablet_replica.cc:330] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.344434 4154 raft_consensus.cc:2229] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.344661 4154 raft_consensus.cc:2258] T cd53ff5fd428440a9a8dcd7aeb7176e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.345012 4154 tablet_replica.cc:330] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.345103 4154 raft_consensus.cc:2229] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 3 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.345284 4154 raft_consensus.cc:2258] T e7501d8c96924fa19f4045735bd261db P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.345628 4154 tablet_replica.cc:330] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932: stopping tablet replica
I20240501 14:02:22.345716 4154 raft_consensus.cc:2229] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:22.345815 4154 raft_consensus.cc:2258] T ac72552c32424e48a5dcef5e877c67e9 P 8e938bc7d5ae465ba95e6629b014f932 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.362003 4154 tablet_server.cc:194] TabletServer@127.4.14.131:0 shutdown complete.
I20240501 14:02:22.366773 4154 master.cc:537] Master@127.4.14.190:35917 shutting down...
I20240501 14:02:22.374543 4154 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 1 LEADER]: Raft consensus shutting down.
I20240501 14:02:22.374811 4154 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:22.374919 4154 tablet_replica.cc:330] T 00000000000000000000000000000000 P e92c9cedde8f43ae80517f1d925240ac: stopping tablet replica
I20240501 14:02:22.388657 4154 master.cc:552] Master@127.4.14.190:35917 shutdown complete.
06fa1aefd7694132978f68c92457c6c8 4
8e938bc7d5ae465ba95e6629b014f932 1
e5e8df89e78d4476a1e647f0316e257e 5
06fa1aefd7694132978f68c92457c6c8 3
8e938bc7d5ae465ba95e6629b014f932 3
e5e8df89e78d4476a1e647f0316e257e 4
06fa1aefd7694132978f68c92457c6c8 1
8e938bc7d5ae465ba95e6629b014f932 1
e5e8df89e78d4476a1e647f0316e257e 8
06fa1aefd7694132978f68c92457c6c8 3
8e938bc7d5ae465ba95e6629b014f932 3
e5e8df89e78d4476a1e647f0316e257e 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27430 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240501 14:02:22.405583 4154 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.14.190:34741
I20240501 14:02:22.406152 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:02:22.409273 5132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.410063 5133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.410542 5135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:22.410965 4154 server_base.cc:1034] running on GCE node
I20240501 14:02:22.411229 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:02:22.411280 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:02:22.411301 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572142411298 us; error 0 us; skew 500 ppm
I20240501 14:02:22.411455 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:02:22.417522 4154 webserver.cc:460] Webserver started at http://127.4.14.190:45177/ using document root <none> and password file <none>
I20240501 14:02:22.417791 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:02:22.417856 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:02:22.418010 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:02:22.418668 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/master-0-root/instance:
uuid: "6aca7a860768467185ea59fbe408e7c1"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.421602 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20240501 14:02:22.423189 5140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.423542 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 14:02:22.423647 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/master-0-root
uuid: "6aca7a860768467185ea59fbe408e7c1"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.423751 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:02:22.435719 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:02:22.436372 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:02:22.449503 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.190:34741
I20240501 14:02:22.449537 5191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.190:34741 every 8 connection(s)
I20240501 14:02:22.450886 5192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.455168 5192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1: Bootstrap starting.
I20240501 14:02:22.456516 5192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.458258 5192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1: No bootstrap required, opened a new log
I20240501 14:02:22.458829 5192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER }
I20240501 14:02:22.458971 5192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.459015 5192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aca7a860768467185ea59fbe408e7c1, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.459165 5192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER }
I20240501 14:02:22.459257 5192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:02:22.459290 5192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:02:22.459340 5192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:22.461239 5192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER }
I20240501 14:02:22.461426 5192 leader_election.cc:302] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6aca7a860768467185ea59fbe408e7c1; no voters:
I20240501 14:02:22.461851 5192 leader_election.cc:288] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:02:22.462016 5195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:22.462905 5195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6aca7a860768467185ea59fbe408e7c1, State: Running, Role: LEADER
I20240501 14:02:22.462970 5192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:02:22.463268 5195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER }
I20240501 14:02:22.465844 5196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6aca7a860768467185ea59fbe408e7c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER } }
I20240501 14:02:22.465831 5197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aca7a860768467185ea59fbe408e7c1. Latest consensus state: current_term: 1 leader_uuid: "6aca7a860768467185ea59fbe408e7c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aca7a860768467185ea59fbe408e7c1" member_type: VOTER } }
I20240501 14:02:22.466029 5196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [sys.catalog]: This master's current role is: LEADER
I20240501 14:02:22.466045 5197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1 [sys.catalog]: This master's current role is: LEADER
I20240501 14:02:22.466598 5202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:02:22.468498 5202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:02:22.472090 5202 catalog_manager.cc:1347] Generated new cluster ID: b65061f16a6642c9b2cde44e8d25c855
I20240501 14:02:22.472214 5202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:02:22.473872 4154 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 14:02:22.485124 5202 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:02:22.485911 5202 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:02:22.492969 5202 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 6aca7a860768467185ea59fbe408e7c1: Generated new TSK 0
I20240501 14:02:22.493232 5202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:02:22.506845 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:02:22.510393 5216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.510828 5214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.510838 5213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:22.511456 4154 server_base.cc:1034] running on GCE node
I20240501 14:02:22.511757 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:02:22.511812 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:02:22.511843 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572142511840 us; error 0 us; skew 500 ppm
I20240501 14:02:22.511978 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:02:22.513231 4154 webserver.cc:460] Webserver started at http://127.4.14.129:41081/ using document root <none> and password file <none>
I20240501 14:02:22.513489 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:02:22.513558 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:02:22.513684 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:02:22.514324 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/instance:
uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.516963 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 14:02:22.518586 5221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.518965 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20240501 14:02:22.519054 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root
uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.519157 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:02:22.540592 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:02:22.541157 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:02:22.541697 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:02:22.542557 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:02:22.542609 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.542676 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:02:22.542721 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.557193 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.129:34507
I20240501 14:02:22.557210 5283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.129:34507 every 8 connection(s)
I20240501 14:02:22.558773 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:02:22.562294 5288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.563014 5289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.563490 5291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:22.564467 4154 server_base.cc:1034] running on GCE node
I20240501 14:02:22.564788 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:02:22.564862 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:02:22.564901 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572142564897 us; error 0 us; skew 500 ppm
I20240501 14:02:22.565058 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:02:22.566059 5284 heartbeater.cc:347] Connected to a master server at 127.4.14.190:34741
I20240501 14:02:22.566190 5284 heartbeater.cc:464] Registering TS with master...
I20240501 14:02:22.566514 4154 webserver.cc:460] Webserver started at http://127.4.14.130:46413/ using document root <none> and password file <none>
I20240501 14:02:22.566633 5284 heartbeater.cc:511] Master 127.4.14.190:34741 requested a full tablet report, sending...
I20240501 14:02:22.566773 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:02:22.566876 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:02:22.567003 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:02:22.567605 5157 ts_manager.cc:194] Registered new tserver with Master: bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:22.567636 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/instance:
uuid: "1f109496867240cab78f9407ecbacf73"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.568714 5157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52682
I20240501 14:02:22.570255 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 14:02:22.571822 5296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.572119 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 14:02:22.572247 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root
uuid: "1f109496867240cab78f9407ecbacf73"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.572350 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:02:22.589675 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:02:22.590246 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:02:22.590845 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:02:22.591751 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:02:22.591809 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.591882 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:02:22.591917 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.604601 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.130:41859
I20240501 14:02:22.604629 5358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.130:41859 every 8 connection(s)
I20240501 14:02:22.606161 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:02:22.610030 5362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:22.610693 5363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:22.611238 4154 server_base.cc:1034] running on GCE node
W20240501 14:02:22.611589 5365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:22.612090 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:02:22.612202 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:02:22.612298 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572142612292 us; error 0 us; skew 500 ppm
I20240501 14:02:22.612457 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:02:22.613477 5359 heartbeater.cc:347] Connected to a master server at 127.4.14.190:34741
I20240501 14:02:22.613588 5359 heartbeater.cc:464] Registering TS with master...
I20240501 14:02:22.613961 5359 heartbeater.cc:511] Master 127.4.14.190:34741 requested a full tablet report, sending...
I20240501 14:02:22.614876 5157 ts_manager.cc:194] Registered new tserver with Master: 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:22.615828 5157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52694
I20240501 14:02:22.622705 4154 webserver.cc:460] Webserver started at http://127.4.14.131:45047/ using document root <none> and password file <none>
I20240501 14:02:22.622941 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:02:22.622995 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:02:22.623090 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:02:22.623719 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/instance:
uuid: "0b5d87b866b04909a7d8d16ea5b25483"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.626240 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:22.628101 5370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.628525 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 14:02:22.628639 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root
uuid: "0b5d87b866b04909a7d8d16ea5b25483"
format_stamp: "Formatted at 2024-05-01 14:02:22 on dist-test-slave-78f7"
I20240501 14:02:22.628755 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:02:22.645090 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:02:22.645704 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:02:22.646312 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:02:22.647164 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:02:22.647222 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.647297 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:02:22.647332 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:22.658890 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.131:35465
I20240501 14:02:22.658907 5432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.131:35465 every 8 connection(s)
I20240501 14:02:22.665346 5433 heartbeater.cc:347] Connected to a master server at 127.4.14.190:34741
I20240501 14:02:22.665508 5433 heartbeater.cc:464] Registering TS with master...
I20240501 14:02:22.665815 5433 heartbeater.cc:511] Master 127.4.14.190:34741 requested a full tablet report, sending...
I20240501 14:02:22.666581 5157 ts_manager.cc:194] Registered new tserver with Master: 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:22.666615 4154 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006801766s
I20240501 14:02:22.667582 5157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52698
I20240501 14:02:22.667656 4154 test_util.cc:268] Using random seed: -276732031
I20240501 14:02:22.679456 5157 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52712:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 14:02:22.680879 5157 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 14:02:22.728340 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 1d14a452a4e14cfb9173b5d4e184ff6f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 14:02:22.728534 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 40017157bdb9475585d127bf93668562 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 14:02:22.728917 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d14a452a4e14cfb9173b5d4e184ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.728858 5324 tablet_service.cc:1467] Processing CreateTablet for tablet 1d14a452a4e14cfb9173b5d4e184ff6f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 14:02:22.729205 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d14a452a4e14cfb9173b5d4e184ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.729182 5396 tablet_service.cc:1467] Processing CreateTablet for tablet 07d904a12cde4e98a7f409f7f0868eae (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 14:02:22.729583 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07d904a12cde4e98a7f409f7f0868eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.733413 5389 tablet_service.cc:1467] Processing CreateTablet for tablet ccc815b1d356477ab81ea553e21f208a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 14:02:22.733875 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccc815b1d356477ab81ea553e21f208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.735111 5394 tablet_service.cc:1467] Processing CreateTablet for tablet b471619f7e3a41f280b47e269eb9afd4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 14:02:22.735556 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b471619f7e3a41f280b47e269eb9afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.736569 5393 tablet_service.cc:1467] Processing CreateTablet for tablet 3e89240009304303a397175ca656c512 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 14:02:22.736989 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e89240009304303a397175ca656c512. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.740622 5392 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2428cca58742fabb9a656f90ce5b47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 14:02:22.740622 5323 tablet_service.cc:1467] Processing CreateTablet for tablet 40017157bdb9475585d127bf93668562 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 14:02:22.741181 5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2428cca58742fabb9a656f90ce5b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.741182 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40017157bdb9475585d127bf93668562. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.744599 5391 tablet_service.cc:1467] Processing CreateTablet for tablet 74d215cf27a64fd985b0ac7b292017f9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 14:02:22.745077 5391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d215cf27a64fd985b0ac7b292017f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.747870 5448 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:22.748315 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 18d6cd1be8584b9281251bbf29f19c39 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 14:02:22.748530 5390 tablet_service.cc:1467] Processing CreateTablet for tablet d241cf94420f448abdc7f154be06c02f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 14:02:22.748690 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d6cd1be8584b9281251bbf29f19c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.748931 5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d241cf94420f448abdc7f154be06c02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.749619 5448 tablet_bootstrap.cc:654] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.750936 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 3f3db9eff53e4ec29ab17081d32097a8 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 14:02:22.751287 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f3db9eff53e4ec29ab17081d32097a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.752502 5395 tablet_service.cc:1467] Processing CreateTablet for tablet caf4e76b1ea74fe3a460dfb8fb802df6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 14:02:22.752872 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4e76b1ea74fe3a460dfb8fb802df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.754736 5389 tablet_service.cc:1467] Processing CreateTablet for tablet dbcc64e86378485cb6231e2ec17a533b (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 14:02:22.755074 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcc64e86378485cb6231e2ec17a533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.756614 5449 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:22.756704 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40017157bdb9475585d127bf93668562. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.758306 5449 tablet_bootstrap.cc:654] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.759429 5324 tablet_service.cc:1467] Processing CreateTablet for tablet 07d904a12cde4e98a7f409f7f0868eae (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 14:02:22.759871 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07d904a12cde4e98a7f409f7f0868eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.760838 5448 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:22.761040 5448 ts_tablet_manager.cc:1367] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240501 14:02:22.761773 5448 raft_consensus.cc:348] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.762111 5448 raft_consensus.cc:374] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.762204 5448 raft_consensus.cc:729] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.762485 5448 consensus_queue.cc:260] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.763621 5323 tablet_service.cc:1467] Processing CreateTablet for tablet caf4e76b1ea74fe3a460dfb8fb802df6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 14:02:22.763860 5394 tablet_service.cc:1467] Processing CreateTablet for tablet 64a7a301cdf6415ea7e3654551f2ed91 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 14:02:22.764047 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4e76b1ea74fe3a460dfb8fb802df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.765753 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a7a301cdf6415ea7e3654551f2ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.767266 5391 tablet_service.cc:1467] Processing CreateTablet for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 14:02:22.767316 5322 tablet_service.cc:1467] Processing CreateTablet for tablet b471619f7e3a41f280b47e269eb9afd4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 14:02:22.778702 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b471619f7e3a41f280b47e269eb9afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.778894 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 00df0bdc59ae4d238be73ada8da1e8b5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 14:02:22.779212 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00df0bdc59ae4d238be73ada8da1e8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.768078 5321 tablet_service.cc:1467] Processing CreateTablet for tablet 3e89240009304303a397175ca656c512 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 14:02:22.780470 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e89240009304303a397175ca656c512. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.781276 5323 tablet_service.cc:1467] Processing CreateTablet for tablet dbcc64e86378485cb6231e2ec17a533b (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 14:02:22.781632 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcc64e86378485cb6231e2ec17a533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.768263 5320 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2428cca58742fabb9a656f90ce5b47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 14:02:22.784499 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2428cca58742fabb9a656f90ce5b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.784544 5324 tablet_service.cc:1467] Processing CreateTablet for tablet 64a7a301cdf6415ea7e3654551f2ed91 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 14:02:22.784940 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a7a301cdf6415ea7e3654551f2ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.785143 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 911e80bff52f48abaea33317a9244f38 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 14:02:22.785477 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 911e80bff52f48abaea33317a9244f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.786386 5249 tablet_service.cc:1467] Processing CreateTablet for tablet 1d14a452a4e14cfb9173b5d4e184ff6f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 14:02:22.786795 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d14a452a4e14cfb9173b5d4e184ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.768924 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 74d215cf27a64fd985b0ac7b292017f9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 14:02:22.788497 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d215cf27a64fd985b0ac7b292017f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.791004 5324 tablet_service.cc:1467] Processing CreateTablet for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 14:02:22.791424 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.770175 5317 tablet_service.cc:1467] Processing CreateTablet for tablet ccc815b1d356477ab81ea553e21f208a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 14:02:22.769548 5318 tablet_service.cc:1467] Processing CreateTablet for tablet d241cf94420f448abdc7f154be06c02f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 14:02:22.791807 5317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccc815b1d356477ab81ea553e21f208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.770788 5316 tablet_service.cc:1467] Processing CreateTablet for tablet 18d6cd1be8584b9281251bbf29f19c39 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 14:02:22.771420 5315 tablet_service.cc:1467] Processing CreateTablet for tablet 3f3db9eff53e4ec29ab17081d32097a8 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 14:02:22.771696 5395 tablet_service.cc:1467] Processing CreateTablet for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 14:02:22.792582 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b0d70a8e37426e8e6f7d11501a1ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.771054 5393 tablet_service.cc:1467] Processing CreateTablet for tablet ca91b0a4dc4a4221ab6f7e6167ade06f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 14:02:22.794600 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca91b0a4dc4a4221ab6f7e6167ade06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.796489 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d6cd1be8584b9281251bbf29f19c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.796988 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 5589c888edde48688e0a953adc192957 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 14:02:22.797346 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5589c888edde48688e0a953adc192957. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.798879 5320 tablet_service.cc:1467] Processing CreateTablet for tablet ca91b0a4dc4a4221ab6f7e6167ade06f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 14:02:22.799233 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca91b0a4dc4a4221ab6f7e6167ade06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.800448 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f3db9eff53e4ec29ab17081d32097a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.800668 5319 tablet_service.cc:1467] Processing CreateTablet for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 14:02:22.801045 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b0d70a8e37426e8e6f7d11501a1ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.802470 5321 tablet_service.cc:1467] Processing CreateTablet for tablet 4de3ce01609d498fbc1318e1717297b6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 14:02:22.802816 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de3ce01609d498fbc1318e1717297b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.803090 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 01a94ff5f43b460e966699c0e9c5730a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 14:02:22.803406 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a94ff5f43b460e966699c0e9c5730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.772581 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 115b22143b004defbaae11ec0b62310f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 14:02:22.804706 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b22143b004defbaae11ec0b62310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.805436 5322 tablet_service.cc:1467] Processing CreateTablet for tablet 115b22143b004defbaae11ec0b62310f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 14:02:22.805765 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b22143b004defbaae11ec0b62310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.775112 5392 tablet_service.cc:1467] Processing CreateTablet for tablet bc4fdc2cf86a44348638047a20860698 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 14:02:22.776388 5449 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:22.776878 5433 heartbeater.cc:503] Master 127.4.14.190:34741 was elected leader, sending a full tablet report...
I20240501 14:02:22.808094 5449 ts_tablet_manager.cc:1367] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.003s
I20240501 14:02:22.775400 5396 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd3884f93c1499783fe394bff59ff04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 14:02:22.808467 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd3884f93c1499783fe394bff59ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.808705 5391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.808903 5449 raft_consensus.cc:348] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.809098 5449 raft_consensus.cc:374] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.809152 5449 raft_consensus.cc:729] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.809355 5449 consensus_queue.cc:260] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.777050 5394 tablet_service.cc:1467] Processing CreateTablet for tablet 4de3ce01609d498fbc1318e1717297b6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 14:02:22.812451 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de3ce01609d498fbc1318e1717297b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.812340 5389 tablet_service.cc:1467] Processing CreateTablet for tablet a26da6c9b322432f934b1de3669f0646 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 14:02:22.812717 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26da6c9b322432f934b1de3669f0646. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.777982 5390 tablet_service.cc:1467] Processing CreateTablet for tablet b1ba525391dc4e00bdbc841f4eeead11 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 14:02:22.777521 5448 ts_tablet_manager.cc:1398] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20240501 14:02:22.791322 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 2c63139d6ab242c2bb31e84df50aaee5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 14:02:22.816969 5448 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:22.817736 5323 tablet_service.cc:1467] Processing CreateTablet for tablet bc4fdc2cf86a44348638047a20860698 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 14:02:22.818149 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4fdc2cf86a44348638047a20860698. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.818264 5247 tablet_service.cc:1467] Processing CreateTablet for tablet 07d904a12cde4e98a7f409f7f0868eae (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 14:02:22.819537 5393 tablet_service.cc:1467] Processing CreateTablet for tablet 44623c1852484ccb95d3aa2238745ec9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 14:02:22.816969 5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4fdc2cf86a44348638047a20860698. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.820233 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c63139d6ab242c2bb31e84df50aaee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.820480 5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ba525391dc4e00bdbc841f4eeead11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.820960 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44623c1852484ccb95d3aa2238745ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.821950 5244 tablet_service.cc:1467] Processing CreateTablet for tablet 3e89240009304303a397175ca656c512 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 14:02:22.822054 5246 tablet_service.cc:1467] Processing CreateTablet for tablet caf4e76b1ea74fe3a460dfb8fb802df6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 14:02:22.822425 5318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d241cf94420f448abdc7f154be06c02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.821950 5245 tablet_service.cc:1467] Processing CreateTablet for tablet b471619f7e3a41f280b47e269eb9afd4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 14:02:22.823470 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd3884f93c1499783fe394bff59ff04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 14:02:22.823535 5395 tablet_service.cc:1467] Processing CreateTablet for tablet 3b72895e50094c2fbcf0383a791594f7 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 14:02:22.823971 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b72895e50094c2fbcf0383a791594f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.824659 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd3884f93c1499783fe394bff59ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.825668 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 40017157bdb9475585d127bf93668562 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 14:02:22.826948 5359 heartbeater.cc:503] Master 127.4.14.190:34741 was elected leader, sending a full tablet report...
I20240501 14:02:22.827580 5448 tablet_bootstrap.cc:654] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.828469 5315 tablet_service.cc:1467] Processing CreateTablet for tablet b1ba525391dc4e00bdbc841f4eeead11 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 14:02:22.828857 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ba525391dc4e00bdbc841f4eeead11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.830405 5448 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:22.830560 5448 ts_tablet_manager.cc:1367] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20240501 14:02:22.831359 5448 raft_consensus.cc:348] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.831552 5448 raft_consensus.cc:374] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.831604 5448 raft_consensus.cc:729] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.831872 5452 raft_consensus.cc:482] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:22.831822 5448 consensus_queue.cc:260] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.833397 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 00df0bdc59ae4d238be73ada8da1e8b5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 14:02:22.833915 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07d904a12cde4e98a7f409f7f0868eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.833941 5398 tablet_service.cc:1467] Processing CreateTablet for tablet cb23750de77847ee96aa43bab357ebd1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 14:02:22.834280 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb23750de77847ee96aa43bab357ebd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.834257 5449 ts_tablet_manager.cc:1398] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.026s user 0.002s sys 0.005s
I20240501 14:02:22.834671 5449 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:22.835222 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00df0bdc59ae4d238be73ada8da1e8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.836334 5240 tablet_service.cc:1467] Processing CreateTablet for tablet ccc815b1d356477ab81ea553e21f208a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 14:02:22.837008 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40017157bdb9475585d127bf93668562. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.837755 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e89240009304303a397175ca656c512. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.840539 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b471619f7e3a41f280b47e269eb9afd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.842288 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4e76b1ea74fe3a460dfb8fb802df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.845227 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccc815b1d356477ab81ea553e21f208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.840380 5242 tablet_service.cc:1467] Processing CreateTablet for tablet 74d215cf27a64fd985b0ac7b292017f9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 14:02:22.843789 5315 tablet_service.cc:1467] Processing CreateTablet for tablet 911e80bff52f48abaea33317a9244f38 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 14:02:22.847465 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 911e80bff52f48abaea33317a9244f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.831991 5452 raft_consensus.cc:504] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.848199 5394 tablet_service.cc:1467] Processing CreateTablet for tablet 3a60c4f4da7f4cd29be5695a78825784 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 14:02:22.848596 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a60c4f4da7f4cd29be5695a78825784. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.845009 5241 tablet_service.cc:1467] Processing CreateTablet for tablet d241cf94420f448abdc7f154be06c02f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 14:02:22.851537 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d215cf27a64fd985b0ac7b292017f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.855170 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 57e68e51675e4d6a8167536678298504 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 14:02:22.855686 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e68e51675e4d6a8167536678298504. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 14:02:22.855765 5360 tablet.cc:2369] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 14:02:22.858994 5243 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2428cca58742fabb9a656f90ce5b47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 14:02:22.860898 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2428cca58742fabb9a656f90ce5b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.863421 5452 leader_election.cc:288] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:22.871652 5320 tablet_service.cc:1467] Processing CreateTablet for tablet 2c63139d6ab242c2bb31e84df50aaee5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 14:02:22.873025 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c63139d6ab242c2bb31e84df50aaee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.878672 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d241cf94420f448abdc7f154be06c02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.895499 5316 tablet_service.cc:1467] Processing CreateTablet for tablet 44623c1852484ccb95d3aa2238745ec9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 14:02:22.895989 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44623c1852484ccb95d3aa2238745ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.889945 5324 tablet_service.cc:1467] Processing CreateTablet for tablet 5589c888edde48688e0a953adc192957 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 14:02:22.901823 5449 tablet_bootstrap.cc:654] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.901823 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5589c888edde48688e0a953adc192957. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.907007 5249 tablet_service.cc:1467] Processing CreateTablet for tablet 18d6cd1be8584b9281251bbf29f19c39 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 14:02:22.907582 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d6cd1be8584b9281251bbf29f19c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.908444 5448 ts_tablet_manager.cc:1398] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.078s user 0.001s sys 0.054s
I20240501 14:02:22.908903 5448 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:22.920452 5322 tablet_service.cc:1467] Processing CreateTablet for tablet 01a94ff5f43b460e966699c0e9c5730a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 14:02:22.920871 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a94ff5f43b460e966699c0e9c5730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.923741 5242 tablet_service.cc:1467] Processing CreateTablet for tablet 3f3db9eff53e4ec29ab17081d32097a8 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 14:02:22.924154 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f3db9eff53e4ec29ab17081d32097a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.924158 5395 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5f7f90f4440d792cbd722f41aa240 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 14:02:22.924924 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5f7f90f4440d792cbd722f41aa240. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.930068 5449 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:22.930219 5449 ts_tablet_manager.cc:1367] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.007s
I20240501 14:02:22.930807 5449 raft_consensus.cc:348] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.930969 5449 raft_consensus.cc:374] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.931022 5449 raft_consensus.cc:729] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.931218 5449 consensus_queue.cc:260] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.931414 5317 tablet_service.cc:1467] Processing CreateTablet for tablet a26da6c9b322432f934b1de3669f0646 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 14:02:22.931708 5449 ts_tablet_manager.cc:1398] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 14:02:22.931901 5317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26da6c9b322432f934b1de3669f0646. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.931989 5449 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:22.933543 5449 tablet_bootstrap.cc:654] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.941623 5449 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:22.941802 5449 ts_tablet_manager.cc:1367] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20240501 14:02:22.946699 5456 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:22.948345 5456 tablet_bootstrap.cc:654] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.954761 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d14a452a4e14cfb9173b5d4e184ff6f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:22.955094 5334 raft_consensus.cc:2454] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:22.955474 5456 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:22.955603 5456 ts_tablet_manager.cc:1367] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20240501 14:02:22.955579 5373 leader_election.cc:302] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:22.955808 5455 raft_consensus.cc:2781] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:22.955890 5455 raft_consensus.cc:482] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:22.955969 5455 raft_consensus.cc:3037] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:22.956149 5390 tablet_service.cc:1467] Processing CreateTablet for tablet a564d8cf00624da7a2cfc98cf6740d84 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 14:02:22.956686 5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a564d8cf00624da7a2cfc98cf6740d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.956784 5456 raft_consensus.cc:348] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.956959 5456 raft_consensus.cc:374] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.957020 5456 raft_consensus.cc:729] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.959481 5449 raft_consensus.cc:348] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.959656 5449 raft_consensus.cc:374] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:22.959709 5449 raft_consensus.cc:729] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:22.960902 5391 tablet_service.cc:1467] Processing CreateTablet for tablet 1025c6d7e15946158542ee55dc976531 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 14:02:22.961258 5391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1025c6d7e15946158542ee55dc976531. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.962306 5449 consensus_queue.cc:260] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.962373 5321 tablet_service.cc:1467] Processing CreateTablet for tablet 3b72895e50094c2fbcf0383a791594f7 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 14:02:22.962745 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b72895e50094c2fbcf0383a791594f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.964208 5396 tablet_service.cc:1467] Processing CreateTablet for tablet 169a7db122934566b091f2379c6e3a04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 14:02:22.964468 5449 ts_tablet_manager.cc:1398] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20240501 14:02:22.964618 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169a7db122934566b091f2379c6e3a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.964776 5449 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:22.957230 5456 consensus_queue.cc:260] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:22.980517 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d14a452a4e14cfb9173b5d4e184ff6f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:22.985566 5323 tablet_service.cc:1467] Processing CreateTablet for tablet cb23750de77847ee96aa43bab357ebd1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 14:02:22.986083 5259 raft_consensus.cc:2454] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:22.987219 5392 tablet_service.cc:1467] Processing CreateTablet for tablet cf222bcb0e12403da462db45e174042f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 14:02:22.987614 5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf222bcb0e12403da462db45e174042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.988071 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb23750de77847ee96aa43bab357ebd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:22.988755 5449 tablet_bootstrap.cc:654] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.989455 5456 ts_tablet_manager.cc:1398] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.034s user 0.012s sys 0.004s
I20240501 14:02:22.989718 5284 heartbeater.cc:503] Master 127.4.14.190:34741 was elected leader, sending a full tablet report...
I20240501 14:02:22.989809 5456 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:22.991834 5448 tablet_bootstrap.cc:654] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:22.999156 5241 tablet_service.cc:1467] Processing CreateTablet for tablet dbcc64e86378485cb6231e2ec17a533b (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 14:02:23.000747 5453 raft_consensus.cc:482] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.000814 5456 tablet_bootstrap.cc:654] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.001024 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcc64e86378485cb6231e2ec17a533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.001161 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 0a22dfec20f8497c9b42035a3ff7c92e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 14:02:23.001559 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a22dfec20f8497c9b42035a3ff7c92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.002022 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 64a7a301cdf6415ea7e3654551f2ed91 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 14:02:23.000924 5453 raft_consensus.cc:504] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.004627 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a7a301cdf6415ea7e3654551f2ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.004995 5247 tablet_service.cc:1467] Processing CreateTablet for tablet ca91b0a4dc4a4221ab6f7e6167ade06f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 14:02:23.007043 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca91b0a4dc4a4221ab6f7e6167ade06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.005792 5240 tablet_service.cc:1467] Processing CreateTablet for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 14:02:23.012420 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfffbd2bdae64276afa3b5b5ca7fd5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.012993 5453 leader_election.cc:288] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.022117 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 3a60c4f4da7f4cd29be5695a78825784 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 14:02:23.022679 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a60c4f4da7f4cd29be5695a78825784. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.019402 5455 raft_consensus.cc:504] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.027581 5320 tablet_service.cc:1467] Processing CreateTablet for tablet 57e68e51675e4d6a8167536678298504 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 14:02:23.028029 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e68e51675e4d6a8167536678298504. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.031380 5244 tablet_service.cc:1467] Processing CreateTablet for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 14:02:23.035035 5455 leader_election.cc:288] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:23.035796 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b0d70a8e37426e8e6f7d11501a1ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.038398 5246 tablet_service.cc:1467] Processing CreateTablet for tablet 4de3ce01609d498fbc1318e1717297b6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 14:02:23.038926 5315 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5f7f90f4440d792cbd722f41aa240 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 14:02:23.039345 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5f7f90f4440d792cbd722f41aa240. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.042009 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d14a452a4e14cfb9173b5d4e184ff6f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.042220 5334 raft_consensus.cc:3037] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.043462 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d14a452a4e14cfb9173b5d4e184ff6f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.043586 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4de3ce01609d498fbc1318e1717297b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.043656 5259 raft_consensus.cc:3037] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.046065 5245 tablet_service.cc:1467] Processing CreateTablet for tablet 115b22143b004defbaae11ec0b62310f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 14:02:23.047679 5393 tablet_service.cc:1467] Processing CreateTablet for tablet 7286a556f2ac4573a52b45a29f4352c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 14:02:23.048897 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7286a556f2ac4573a52b45a29f4352c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.050964 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 115b22143b004defbaae11ec0b62310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.054836 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 37d5b2fbe1f043e3923e2012d65c2c09 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 14:02:23.054324 5394 tablet_service.cc:1467] Processing CreateTablet for tablet 18a065dab27a4f8a953b2154d14d06da (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 14:02:23.058673 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d5b2fbe1f043e3923e2012d65c2c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.060947 5334 raft_consensus.cc:2454] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.061859 5373 leader_election.cc:302] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:23.062144 5455 raft_consensus.cc:2781] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.062322 5455 raft_consensus.cc:686] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:23.063071 5318 tablet_service.cc:1467] Processing CreateTablet for tablet a564d8cf00624da7a2cfc98cf6740d84 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 14:02:23.064118 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a065dab27a4f8a953b2154d14d06da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.065696 5318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a564d8cf00624da7a2cfc98cf6740d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.080685 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 8718449d6e4240ec8e54633aa87f7625 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 14:02:23.082803 5316 tablet_service.cc:1467] Processing CreateTablet for tablet 1025c6d7e15946158542ee55dc976531 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 14:02:23.083349 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1025c6d7e15946158542ee55dc976531. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.083830 5243 tablet_service.cc:1467] Processing CreateTablet for tablet bc4fdc2cf86a44348638047a20860698 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 14:02:23.085382 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4fdc2cf86a44348638047a20860698. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.071527 5455 consensus_queue.cc:237] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.088969 5448 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.089186 5448 ts_tablet_manager.cc:1367] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.180s user 0.018s sys 0.023s
I20240501 14:02:23.094316 5317 tablet_service.cc:1467] Processing CreateTablet for tablet 169a7db122934566b091f2379c6e3a04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 14:02:23.094815 5317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169a7db122934566b091f2379c6e3a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.095466 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8718449d6e4240ec8e54633aa87f7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.105269 5448 raft_consensus.cc:348] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.105537 5448 raft_consensus.cc:374] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.105604 5448 raft_consensus.cc:729] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.105881 5448 consensus_queue.cc:260] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.106437 5448 ts_tablet_manager.cc:1398] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20240501 14:02:23.106752 5448 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.112430 5449 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.112615 5449 ts_tablet_manager.cc:1367] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.148s user 0.019s sys 0.022s
I20240501 14:02:23.113368 5449 raft_consensus.cc:348] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.113564 5449 raft_consensus.cc:374] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.113620 5456 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.113623 5449 raft_consensus.cc:729] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.113754 5456 ts_tablet_manager.cc:1367] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.124s user 0.003s sys 0.013s
I20240501 14:02:23.113873 5449 consensus_queue.cc:260] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.117508 5449 ts_tablet_manager.cc:1398] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 14:02:23.117915 5449 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.129102 5456 raft_consensus.cc:348] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.129400 5456 raft_consensus.cc:374] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.129484 5456 raft_consensus.cc:729] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.130026 5242 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd3884f93c1499783fe394bff59ff04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 14:02:23.130483 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd3884f93c1499783fe394bff59ff04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.130575 5456 consensus_queue.cc:260] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.134940 5259 raft_consensus.cc:2454] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.137003 5324 tablet_service.cc:1467] Processing CreateTablet for tablet cf222bcb0e12403da462db45e174042f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 14:02:23.137195 5395 tablet_service.cc:1467] Processing CreateTablet for tablet a17f01f800ae4100b1effa705cf531c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 14:02:23.137391 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf222bcb0e12403da462db45e174042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.137524 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17f01f800ae4100b1effa705cf531c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.123958 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.138783 5299 leader_election.cc:341] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.141856 5322 tablet_service.cc:1467] Processing CreateTablet for tablet 0a22dfec20f8497c9b42035a3ff7c92e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 14:02:23.141858 5249 tablet_service.cc:1467] Processing CreateTablet for tablet a26da6c9b322432f934b1de3669f0646 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 14:02:23.142284 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a22dfec20f8497c9b42035a3ff7c92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.142392 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26da6c9b322432f934b1de3669f0646. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.144428 5456 ts_tablet_manager.cc:1398] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20240501 14:02:23.144804 5456 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.147811 5456 tablet_bootstrap.cc:654] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.147847 5449 tablet_bootstrap.cc:654] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.153695 5157 catalog_manager.cc:5484] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:23.157384 5321 tablet_service.cc:1467] Processing CreateTablet for tablet 37d5b2fbe1f043e3923e2012d65c2c09 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 14:02:23.157867 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d5b2fbe1f043e3923e2012d65c2c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.157377 5392 tablet_service.cc:1467] Processing CreateTablet for tablet 32aa0719fcbe4ce2af3113452bb72901 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 14:02:23.158207 5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32aa0719fcbe4ce2af3113452bb72901. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.169901 5397 tablet_service.cc:1467] Processing CreateTablet for tablet d3709ce4d5d845d3863fe71b6b5a77a3 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 14:02:23.170809 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3709ce4d5d845d3863fe71b6b5a77a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.174213 5396 tablet_service.cc:1467] Processing CreateTablet for tablet 5dc3b18a3914454aa31c111dba67ed47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 14:02:23.174762 5455 raft_consensus.cc:482] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.175953 5448 tablet_bootstrap.cc:654] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.176795 5455 raft_consensus.cc:504] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.177001 5390 tablet_service.cc:1467] Processing CreateTablet for tablet e812adb37a6849e0881bcc1abb248aa9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 14:02:23.177448 5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e812adb37a6849e0881bcc1abb248aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.177641 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dc3b18a3914454aa31c111dba67ed47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.180096 5455 leader_election.cc:288] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.179159 5323 tablet_service.cc:1467] Processing CreateTablet for tablet 7286a556f2ac4573a52b45a29f4352c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 14:02:23.181535 5455 raft_consensus.cc:482] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.181988 5320 tablet_service.cc:1467] Processing CreateTablet for tablet 18a065dab27a4f8a953b2154d14d06da (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 14:02:23.182008 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.182579 5373 leader_election.cc:341] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.184548 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7286a556f2ac4573a52b45a29f4352c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.184768 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a065dab27a4f8a953b2154d14d06da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.185525 5455 raft_consensus.cc:504] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.187747 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:23.188601 5373 leader_election.cc:341] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.188736 5373 leader_election.cc:302] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.189334 5452 raft_consensus.cc:2726] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.193190 5245 tablet_service.cc:1467] Processing CreateTablet for tablet b1ba525391dc4e00bdbc841f4eeead11 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 14:02:23.193758 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ba525391dc4e00bdbc841f4eeead11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.195575 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 8718449d6e4240ec8e54633aa87f7625 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 14:02:23.196870 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8718449d6e4240ec8e54633aa87f7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.200879 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.201625 5373 leader_election.cc:341] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.202401 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 00df0bdc59ae4d238be73ada8da1e8b5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 14:02:23.203078 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00df0bdc59ae4d238be73ada8da1e8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.203071 5240 tablet_service.cc:1467] Processing CreateTablet for tablet 911e80bff52f48abaea33317a9244f38 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 14:02:23.203637 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 911e80bff52f48abaea33317a9244f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.204640 5455 leader_election.cc:288] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.211529 5391 tablet_service.cc:1467] Processing CreateTablet for tablet 3af53f955ad24b1b8b4c748924354d67 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 14:02:23.212055 5391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af53f955ad24b1b8b4c748924354d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.213902 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:23.214731 5373 leader_election.cc:341] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.214890 5373 leader_election.cc:302] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.215821 5455 raft_consensus.cc:2726] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.216152 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:23.226964 5298 leader_election.cc:341] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.227097 5298 leader_election.cc:302] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.227460 5453 raft_consensus.cc:2726] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.226223 5394 tablet_service.cc:1467] Processing CreateTablet for tablet 02c56c9e7d0c409795b52d9ebdf2d32a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 14:02:23.228513 5243 tablet_service.cc:1467] Processing CreateTablet for tablet 2c63139d6ab242c2bb31e84df50aaee5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 14:02:23.228891 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c63139d6ab242c2bb31e84df50aaee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.228634 5394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02c56c9e7d0c409795b52d9ebdf2d32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.234867 5247 tablet_service.cc:1467] Processing CreateTablet for tablet 5589c888edde48688e0a953adc192957 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 14:02:23.234954 5317 tablet_service.cc:1467] Processing CreateTablet for tablet a17f01f800ae4100b1effa705cf531c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 14:02:23.235298 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5589c888edde48688e0a953adc192957. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.235380 5317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17f01f800ae4100b1effa705cf531c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.235704 5393 tablet_service.cc:1467] Processing CreateTablet for tablet c81d276fcaa44ae2877fafee9d08d725 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 14:02:23.236048 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c81d276fcaa44ae2877fafee9d08d725. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.236331 5453 raft_consensus.cc:482] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.236459 5453 raft_consensus.cc:504] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.236901 5315 tablet_service.cc:1467] Processing CreateTablet for tablet 32aa0719fcbe4ce2af3113452bb72901 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 14:02:23.237277 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32aa0719fcbe4ce2af3113452bb72901. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.240063 5244 tablet_service.cc:1467] Processing CreateTablet for tablet 44623c1852484ccb95d3aa2238745ec9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 14:02:23.240613 5453 leader_election.cc:288] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.241209 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44623c1852484ccb95d3aa2238745ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.241197 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:23.241606 5298 leader_election.cc:341] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.242360 5456 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.242499 5456 ts_tablet_manager.cc:1367] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.098s user 0.016s sys 0.012s
I20240501 14:02:23.243000 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.243423 5299 leader_election.cc:341] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.243521 5299 leader_election.cc:302] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.243765 5453 raft_consensus.cc:2726] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.244789 5456 raft_consensus.cc:348] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.244997 5456 raft_consensus.cc:374] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.245045 5456 raft_consensus.cc:729] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.245126 5449 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.245245 5449 ts_tablet_manager.cc:1367] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.127s user 0.020s sys 0.016s
I20240501 14:02:23.245244 5456 consensus_queue.cc:260] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.245764 5456 ts_tablet_manager.cc:1398] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:23.245858 5241 tablet_service.cc:1467] Processing CreateTablet for tablet 01a94ff5f43b460e966699c0e9c5730a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 14:02:23.245877 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 35bdf6ec90ce49ea9237042c1849db2a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 14:02:23.246063 5456 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.246238 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35bdf6ec90ce49ea9237042c1849db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.247591 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a94ff5f43b460e966699c0e9c5730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.253167 5453 raft_consensus.cc:482] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.253226 5449 raft_consensus.cc:348] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.254092 5449 raft_consensus.cc:374] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.254168 5449 raft_consensus.cc:729] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.254947 5453 raft_consensus.cc:504] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.255447 5449 consensus_queue.cc:260] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.255686 5453 leader_election.cc:288] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.256156 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:23.256736 5298 leader_election.cc:341] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.257153 5389 tablet_service.cc:1467] Processing CreateTablet for tablet 94e6281c4a6f48f89ce15de7116ef7bc (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 14:02:23.258121 5389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e6281c4a6f48f89ce15de7116ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.260036 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.260598 5299 leader_election.cc:341] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.260742 5299 leader_election.cc:302] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.261004 5453 raft_consensus.cc:2726] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.263240 5448 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.267720 5448 ts_tablet_manager.cc:1367] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.157s user 0.016s sys 0.014s
I20240501 14:02:23.267870 5246 tablet_service.cc:1467] Processing CreateTablet for tablet 3b72895e50094c2fbcf0383a791594f7 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 14:02:23.268335 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b72895e50094c2fbcf0383a791594f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.268630 5448 raft_consensus.cc:348] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.272739 5448 raft_consensus.cc:374] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.276589 5448 raft_consensus.cc:729] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.284013 5448 consensus_queue.cc:260] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.285998 5318 tablet_service.cc:1467] Processing CreateTablet for tablet d3709ce4d5d845d3863fe71b6b5a77a3 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 14:02:23.291463 5318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3709ce4d5d845d3863fe71b6b5a77a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.294390 5448 ts_tablet_manager.cc:1398] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20240501 14:02:23.295047 5449 ts_tablet_manager.cc:1398] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.039s user 0.001s sys 0.021s
I20240501 14:02:23.295439 5324 tablet_service.cc:1467] Processing CreateTablet for tablet e812adb37a6849e0881bcc1abb248aa9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 14:02:23.297461 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e812adb37a6849e0881bcc1abb248aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.298789 5316 tablet_service.cc:1467] Processing CreateTablet for tablet 5dc3b18a3914454aa31c111dba67ed47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 14:02:23.299013 5449 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.300401 5461 raft_consensus.cc:482] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.300311 5322 tablet_service.cc:1467] Processing CreateTablet for tablet 3af53f955ad24b1b8b4c748924354d67 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 14:02:23.302513 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dc3b18a3914454aa31c111dba67ed47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.304368 5461 raft_consensus.cc:504] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.304477 5245 tablet_service.cc:1467] Processing CreateTablet for tablet cb23750de77847ee96aa43bab357ebd1 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 14:02:23.304912 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb23750de77847ee96aa43bab357ebd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.304394 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af53f955ad24b1b8b4c748924354d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.306047 5461 leader_election.cc:288] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.310042 5456 tablet_bootstrap.cc:654] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.310750 5448 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.315686 5448 tablet_bootstrap.cc:654] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.325475 5249 tablet_service.cc:1467] Processing CreateTablet for tablet 3a60c4f4da7f4cd29be5695a78825784 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 14:02:23.327289 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a60c4f4da7f4cd29be5695a78825784. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.329267 5321 tablet_service.cc:1467] Processing CreateTablet for tablet 02c56c9e7d0c409795b52d9ebdf2d32a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 14:02:23.334190 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02c56c9e7d0c409795b52d9ebdf2d32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.335235 5390 tablet_service.cc:1467] Processing CreateTablet for tablet 4186e4fa8faf4984a9f83ec965a810b4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 14:02:23.335595 5390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186e4fa8faf4984a9f83ec965a810b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.337666 5242 tablet_service.cc:1467] Processing CreateTablet for tablet 57e68e51675e4d6a8167536678298504 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 14:02:23.338019 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e68e51675e4d6a8167536678298504. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.343575 5247 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5f7f90f4440d792cbd722f41aa240 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 14:02:23.343825 5396 tablet_service.cc:1467] Processing CreateTablet for tablet c92911631b1342ba9e020fd73c191980 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 14:02:23.344249 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c92911631b1342ba9e020fd73c191980. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.343961 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5f7f90f4440d792cbd722f41aa240. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.352696 5397 tablet_service.cc:1467] Processing CreateTablet for tablet 587c0dc399e44ac3b1a2af885428ea46 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 14:02:23.354135 5397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c0dc399e44ac3b1a2af885428ea46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.356657 5448 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.356809 5448 ts_tablet_manager.cc:1367] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.062s user 0.013s sys 0.000s
I20240501 14:02:23.359067 5395 tablet_service.cc:1467] Processing CreateTablet for tablet 848215fa967849659cac8e5043ade761 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 14:02:23.360528 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848215fa967849659cac8e5043ade761. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.360946 5449 tablet_bootstrap.cc:654] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.364030 5392 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5e6f81c0344dd98ed536563b784bf5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 14:02:23.365154 5392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5e6f81c0344dd98ed536563b784bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.368738 5240 tablet_service.cc:1467] Processing CreateTablet for tablet a564d8cf00624da7a2cfc98cf6740d84 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 14:02:23.369103 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a564d8cf00624da7a2cfc98cf6740d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.374706 5398 tablet_service.cc:1467] Processing CreateTablet for tablet e5011d7ebf1c4953aaf028ff5fbfb13e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 14:02:23.375243 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5011d7ebf1c4953aaf028ff5fbfb13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.376477 5323 tablet_service.cc:1467] Processing CreateTablet for tablet c81d276fcaa44ae2877fafee9d08d725 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 14:02:23.377653 5323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c81d276fcaa44ae2877fafee9d08d725. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.380245 5319 tablet_service.cc:1467] Processing CreateTablet for tablet 35bdf6ec90ce49ea9237042c1849db2a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 14:02:23.380785 5319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35bdf6ec90ce49ea9237042c1849db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.384446 5324 tablet_service.cc:1467] Processing CreateTablet for tablet 94e6281c4a6f48f89ce15de7116ef7bc (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 14:02:23.385114 5243 tablet_service.cc:1467] Processing CreateTablet for tablet 1025c6d7e15946158542ee55dc976531 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 14:02:23.386643 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e6281c4a6f48f89ce15de7116ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.387954 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1025c6d7e15946158542ee55dc976531. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.392115 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 169a7db122934566b091f2379c6e3a04 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 14:02:23.393163 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169a7db122934566b091f2379c6e3a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.397748 5456 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.400733 5448 raft_consensus.cc:348] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.403008 5449 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.404454 5318 tablet_service.cc:1467] Processing CreateTablet for tablet 4186e4fa8faf4984a9f83ec965a810b4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 14:02:23.406682 5448 raft_consensus.cc:374] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.407925 5461 raft_consensus.cc:482] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.408208 5456 ts_tablet_manager.cc:1367] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.152s user 0.011s sys 0.022s
I20240501 14:02:23.408814 5318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186e4fa8faf4984a9f83ec965a810b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.410728 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d215cf27a64fd985b0ac7b292017f9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.413247 5448 raft_consensus.cc:729] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.412729 5315 tablet_service.cc:1467] Processing CreateTablet for tablet c92911631b1342ba9e020fd73c191980 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 14:02:23.413082 5461 raft_consensus.cc:504] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.413522 5448 consensus_queue.cc:260] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.416859 5461 leader_election.cc:288] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.417169 5449 ts_tablet_manager.cc:1367] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.108s user 0.008s sys 0.008s
I20240501 14:02:23.417548 5315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c92911631b1342ba9e020fd73c191980. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.420511 5408 raft_consensus.cc:2454] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.421787 5456 raft_consensus.cc:348] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.421455 5320 tablet_service.cc:1467] Processing CreateTablet for tablet 587c0dc399e44ac3b1a2af885428ea46 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 14:02:23.426800 5223 leader_election.cc:302] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.427119 5461 raft_consensus.cc:2781] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.427206 5461 raft_consensus.cc:482] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.428256 5448 ts_tablet_manager.cc:1398] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.059s user 0.003s sys 0.000s
I20240501 14:02:23.425963 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d215cf27a64fd985b0ac7b292017f9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.428486 5320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c0dc399e44ac3b1a2af885428ea46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.421227 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.429580 5461 raft_consensus.cc:3037] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.429842 5449 raft_consensus.cc:348] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
W20240501 14:02:23.430043 5223 leader_election.cc:341] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.433012 5456 raft_consensus.cc:374] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.433779 5448 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
W20240501 14:02:23.435110 5224 leader_election.cc:341] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.435195 5449 raft_consensus.cc:374] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.435314 5449 raft_consensus.cc:729] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.435163 5322 tablet_service.cc:1467] Processing CreateTablet for tablet 848215fa967849659cac8e5043ade761 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 14:02:23.435676 5241 tablet_service.cc:1467] Processing CreateTablet for tablet cf222bcb0e12403da462db45e174042f (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 14:02:23.435971 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf222bcb0e12403da462db45e174042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.433377 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.437268 5456 raft_consensus.cc:729] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.441207 5322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848215fa967849659cac8e5043ade761. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.442586 5456 consensus_queue.cc:260] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.438386 5449 consensus_queue.cc:260] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.444214 5449 ts_tablet_manager.cc:1398] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20240501 14:02:23.444502 5449 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.445125 5246 tablet_service.cc:1467] Processing CreateTablet for tablet 0a22dfec20f8497c9b42035a3ff7c92e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 14:02:23.445456 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a22dfec20f8497c9b42035a3ff7c92e. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 14:02:23.448216 5224 leader_election.cc:341] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.448350 5224 leader_election.cc:302] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.452860 5244 tablet_service.cc:1467] Processing CreateTablet for tablet 37d5b2fbe1f043e3923e2012d65c2c09 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 14:02:23.453243 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d5b2fbe1f043e3923e2012d65c2c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.460048 5316 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5e6f81c0344dd98ed536563b784bf5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 14:02:23.460621 5316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5e6f81c0344dd98ed536563b784bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.463044 5317 tablet_service.cc:1467] Processing CreateTablet for tablet e5011d7ebf1c4953aaf028ff5fbfb13e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 14:02:23.463478 5317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5011d7ebf1c4953aaf028ff5fbfb13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.466684 5476 raft_consensus.cc:2726] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.469839 5461 raft_consensus.cc:504] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.483343 5461 leader_election.cc:288] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.483745 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d215cf27a64fd985b0ac7b292017f9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:23.483953 5407 raft_consensus.cc:3037] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.488385 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d215cf27a64fd985b0ac7b292017f9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:23.492409 5206 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 14:02:23.492851 5244 tablet_service.cc:1467] Processing CreateTablet for tablet 7286a556f2ac4573a52b45a29f4352c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 14:02:23.493261 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7286a556f2ac4573a52b45a29f4352c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 14:02:23.495416 5224 leader_election.cc:341] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.495644 5407 raft_consensus.cc:2454] T 74d215cf27a64fd985b0ac7b292017f9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:23.496099 5247 tablet_service.cc:1467] Processing CreateTablet for tablet 18a065dab27a4f8a953b2154d14d06da (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 14:02:23.497824 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a065dab27a4f8a953b2154d14d06da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.499142 5242 tablet_service.cc:1467] Processing CreateTablet for tablet 8718449d6e4240ec8e54633aa87f7625 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 14:02:23.499480 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8718449d6e4240ec8e54633aa87f7625. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.498023 5223 leader_election.cc:302] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.502761 5461 raft_consensus.cc:2781] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.502955 5461 raft_consensus.cc:686] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:23.503428 5240 tablet_service.cc:1467] Processing CreateTablet for tablet a17f01f800ae4100b1effa705cf531c6 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 14:02:23.503959 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a17f01f800ae4100b1effa705cf531c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.503815 5461 consensus_queue.cc:237] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.505376 5249 tablet_service.cc:1467] Processing CreateTablet for tablet 32aa0719fcbe4ce2af3113452bb72901 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 14:02:23.505697 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32aa0719fcbe4ce2af3113452bb72901. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.507128 5241 tablet_service.cc:1467] Processing CreateTablet for tablet d3709ce4d5d845d3863fe71b6b5a77a3 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 14:02:23.507634 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3709ce4d5d845d3863fe71b6b5a77a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.507601 5245 tablet_service.cc:1467] Processing CreateTablet for tablet 5dc3b18a3914454aa31c111dba67ed47 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 14:02:23.507915 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dc3b18a3914454aa31c111dba67ed47. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.512517 5243 tablet_service.cc:1467] Processing CreateTablet for tablet e812adb37a6849e0881bcc1abb248aa9 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 14:02:23.514063 5449 tablet_bootstrap.cc:654] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.516564 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 3af53f955ad24b1b8b4c748924354d67 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 14:02:23.520982 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e812adb37a6849e0881bcc1abb248aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.521222 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af53f955ad24b1b8b4c748924354d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.524418 5448 tablet_bootstrap.cc:654] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.530944 5455 raft_consensus.cc:482] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.531126 5455 raft_consensus.cc:504] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.531803 5455 leader_election.cc:288] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.532564 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:23.533401 5373 leader_election.cc:341] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.530978 5247 tablet_service.cc:1467] Processing CreateTablet for tablet 02c56c9e7d0c409795b52d9ebdf2d32a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 14:02:23.536713 5247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02c56c9e7d0c409795b52d9ebdf2d32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.537328 5456 ts_tablet_manager.cc:1398] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.129s user 0.022s sys 0.046s
I20240501 14:02:23.537628 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.537835 5456 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
W20240501 14:02:23.538132 5373 leader_election.cc:341] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.538251 5373 leader_election.cc:302] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.538491 5455 raft_consensus.cc:2726] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.538738 5455 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:23.540081 5456 tablet_bootstrap.cc:654] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.559185 5246 tablet_service.cc:1467] Processing CreateTablet for tablet c81d276fcaa44ae2877fafee9d08d725 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 14:02:23.559756 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c81d276fcaa44ae2877fafee9d08d725. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.570556 5245 tablet_service.cc:1467] Processing CreateTablet for tablet 35bdf6ec90ce49ea9237042c1849db2a (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 14:02:23.571115 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35bdf6ec90ce49ea9237042c1849db2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.579280 5449 tablet_bootstrap.cc:492] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.579488 5449 ts_tablet_manager.cc:1367] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.135s user 0.021s sys 0.017s
I20240501 14:02:23.580538 5155 catalog_manager.cc:5484] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:23.589833 5249 tablet_service.cc:1467] Processing CreateTablet for tablet 94e6281c4a6f48f89ce15de7116ef7bc (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 14:02:23.590385 5249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e6281c4a6f48f89ce15de7116ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.593313 5244 tablet_service.cc:1467] Processing CreateTablet for tablet 4186e4fa8faf4984a9f83ec965a810b4 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 14:02:23.594357 5244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186e4fa8faf4984a9f83ec965a810b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.598297 5242 tablet_service.cc:1467] Processing CreateTablet for tablet c92911631b1342ba9e020fd73c191980 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 14:02:23.600903 5242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c92911631b1342ba9e020fd73c191980. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.605376 5243 tablet_service.cc:1467] Processing CreateTablet for tablet 587c0dc399e44ac3b1a2af885428ea46 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 14:02:23.605911 5243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587c0dc399e44ac3b1a2af885428ea46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.606176 5240 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5e6f81c0344dd98ed536563b784bf5 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 14:02:23.606643 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5e6f81c0344dd98ed536563b784bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.606560 5241 tablet_service.cc:1467] Processing CreateTablet for tablet 848215fa967849659cac8e5043ade761 (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 14:02:23.608816 5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848215fa967849659cac8e5043ade761. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.612423 5449 raft_consensus.cc:348] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.612677 5449 raft_consensus.cc:374] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.612735 5449 raft_consensus.cc:729] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.613703 5449 consensus_queue.cc:260] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.614223 5448 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.614389 5448 ts_tablet_manager.cc:1367] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.186s user 0.009s sys 0.018s
I20240501 14:02:23.615164 5448 raft_consensus.cc:348] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.615375 5448 raft_consensus.cc:374] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.615175 5246 tablet_service.cc:1467] Processing CreateTablet for tablet e5011d7ebf1c4953aaf028ff5fbfb13e (DEFAULT_TABLE table=test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 14:02:23.615850 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5011d7ebf1c4953aaf028ff5fbfb13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:23.616333 5470 raft_consensus.cc:482] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.616461 5470 raft_consensus.cc:504] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.617249 5470 leader_election.cc:288] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.618064 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.615456 5448 raft_consensus.cc:729] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.618398 5449 ts_tablet_manager.cc:1398] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.039s user 0.001s sys 0.002s
W20240501 14:02:23.619304 5298 leader_election.cc:341] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.619650 5449 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.621064 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.621763 5299 leader_election.cc:341] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.621912 5299 leader_election.cc:302] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.622371 5470 raft_consensus.cc:2726] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.623163 5448 consensus_queue.cc:260] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.627699 5448 ts_tablet_manager.cc:1398] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20240501 14:02:23.628683 5448 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.630518 5455 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:23.631748 5449 tablet_bootstrap.cc:654] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.643962 5456 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.644160 5456 ts_tablet_manager.cc:1367] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.107s user 0.012s sys 0.025s
I20240501 14:02:23.669103 5456 raft_consensus.cc:348] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.669521 5456 raft_consensus.cc:374] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.669632 5456 raft_consensus.cc:729] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.669975 5456 consensus_queue.cc:260] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.670683 5456 ts_tablet_manager.cc:1398] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20240501 14:02:23.676369 5456 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.678545 5456 tablet_bootstrap.cc:654] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.679911 5448 tablet_bootstrap.cc:654] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.682792 5449 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.682978 5449 ts_tablet_manager.cc:1367] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.063s user 0.018s sys 0.014s
I20240501 14:02:23.684087 5449 raft_consensus.cc:348] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.684306 5449 raft_consensus.cc:374] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.684350 5449 raft_consensus.cc:729] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.684556 5449 consensus_queue.cc:260] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.684955 5449 ts_tablet_manager.cc:1398] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.685052 5456 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.685179 5456 ts_tablet_manager.cc:1367] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.003s
I20240501 14:02:23.685189 5449 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.685870 5456 raft_consensus.cc:348] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.686048 5456 raft_consensus.cc:374] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.686127 5456 raft_consensus.cc:729] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.686369 5456 consensus_queue.cc:260] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.686549 5449 tablet_bootstrap.cc:654] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.686890 5456 ts_tablet_manager.cc:1398] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:23.687227 5456 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.689339 5456 tablet_bootstrap.cc:654] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.691696 5456 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.691885 5456 ts_tablet_manager.cc:1367] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 14:02:23.692835 5449 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.692741 5456 raft_consensus.cc:348] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.692973 5456 raft_consensus.cc:374] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.692977 5449 ts_tablet_manager.cc:1367] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.004s
I20240501 14:02:23.693049 5456 raft_consensus.cc:729] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.693277 5456 consensus_queue.cc:260] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.693625 5449 raft_consensus.cc:348] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.693828 5449 raft_consensus.cc:374] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.693889 5449 raft_consensus.cc:729] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.693920 5456 ts_tablet_manager.cc:1398] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.694077 5449 consensus_queue.cc:260] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.694190 5456 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.694618 5449 ts_tablet_manager.cc:1398] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.694948 5449 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.695966 5456 tablet_bootstrap.cc:654] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.696688 5449 tablet_bootstrap.cc:654] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.702436 5448 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.702436 5449 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.702641 5448 ts_tablet_manager.cc:1367] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.007s
I20240501 14:02:23.702677 5449 ts_tablet_manager.cc:1367] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20240501 14:02:23.702842 5456 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.703011 5456 ts_tablet_manager.cc:1367] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20240501 14:02:23.703613 5456 raft_consensus.cc:348] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.703562 5448 raft_consensus.cc:348] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.703562 5449 raft_consensus.cc:348] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.703814 5448 raft_consensus.cc:374] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.703788 5456 raft_consensus.cc:374] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.703860 5449 raft_consensus.cc:374] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.703866 5448 raft_consensus.cc:729] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.703923 5449 raft_consensus.cc:729] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.703888 5456 raft_consensus.cc:729] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.704138 5456 consensus_queue.cc:260] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.704136 5449 consensus_queue.cc:260] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.704136 5448 consensus_queue.cc:260] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.704699 5449 ts_tablet_manager.cc:1398] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 14:02:23.705051 5449 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.706033 5448 ts_tablet_manager.cc:1398] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240501 14:02:23.706300 5448 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.706785 5449 tablet_bootstrap.cc:654] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.707437 5456 ts_tablet_manager.cc:1398] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 14:02:23.707896 5448 tablet_bootstrap.cc:654] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.708684 5456 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.710426 5456 tablet_bootstrap.cc:654] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.716128 5449 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.716387 5449 ts_tablet_manager.cc:1367] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20240501 14:02:23.716562 5448 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.716706 5448 ts_tablet_manager.cc:1367] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20240501 14:02:23.717097 5456 tablet_bootstrap.cc:492] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.717257 5456 ts_tablet_manager.cc:1367] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20240501 14:02:23.717224 5449 raft_consensus.cc:348] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.717334 5448 raft_consensus.cc:348] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.717442 5449 raft_consensus.cc:374] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.717480 5448 raft_consensus.cc:374] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.717492 5449 raft_consensus.cc:729] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.717593 5448 raft_consensus.cc:729] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.717793 5449 consensus_queue.cc:260] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.717793 5448 consensus_queue.cc:260] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.717939 5456 raft_consensus.cc:348] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.718135 5456 raft_consensus.cc:374] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.718195 5456 raft_consensus.cc:729] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.718462 5449 ts_tablet_manager.cc:1398] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.718443 5456 consensus_queue.cc:260] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.718753 5449 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.720422 5456 ts_tablet_manager.cc:1398] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:02:23.720598 5449 tablet_bootstrap.cc:654] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.720784 5456 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.722503 5456 tablet_bootstrap.cc:654] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.724103 5448 ts_tablet_manager.cc:1398] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240501 14:02:23.724591 5449 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.724611 5448 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.724738 5449 ts_tablet_manager.cc:1367] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240501 14:02:23.725579 5449 raft_consensus.cc:348] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.726887 5448 tablet_bootstrap.cc:654] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.729135 5448 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.729400 5448 ts_tablet_manager.cc:1367] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20240501 14:02:23.730211 5448 raft_consensus.cc:348] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.730489 5448 raft_consensus.cc:374] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.730522 5456 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.730612 5448 raft_consensus.cc:729] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.730751 5456 ts_tablet_manager.cc:1367] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.007s
I20240501 14:02:23.730849 5448 consensus_queue.cc:260] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.731345 5448 ts_tablet_manager.cc:1398] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.731459 5456 raft_consensus.cc:348] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.731626 5456 raft_consensus.cc:374] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.731674 5456 raft_consensus.cc:729] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.731856 5456 consensus_queue.cc:260] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.732053 5448 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.732298 5456 ts_tablet_manager.cc:1398] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 14:02:23.732539 5456 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.733779 5448 tablet_bootstrap.cc:654] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.733932 5456 tablet_bootstrap.cc:654] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.739351 5449 raft_consensus.cc:374] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.739514 5449 raft_consensus.cc:729] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.739775 5449 consensus_queue.cc:260] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.740471 5449 ts_tablet_manager.cc:1398] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20240501 14:02:23.740861 5449 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.742262 5449 tablet_bootstrap.cc:654] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.742636 5456 tablet_bootstrap.cc:492] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.742722 5448 tablet_bootstrap.cc:492] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.742771 5456 ts_tablet_manager.cc:1367] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20240501 14:02:23.742866 5448 ts_tablet_manager.cc:1367] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240501 14:02:23.743533 5448 raft_consensus.cc:348] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.743616 5456 raft_consensus.cc:348] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.743753 5448 raft_consensus.cc:374] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.743819 5456 raft_consensus.cc:374] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.743825 5448 raft_consensus.cc:729] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.743883 5456 raft_consensus.cc:729] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.744118 5448 consensus_queue.cc:260] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.744119 5456 consensus_queue.cc:260] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.744704 5448 ts_tablet_manager.cc:1398] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 14:02:23.744756 5456 ts_tablet_manager.cc:1398] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.745069 5456 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.745550 5448 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.746752 5456 tablet_bootstrap.cc:654] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.746906 5448 tablet_bootstrap.cc:654] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.749953 5485 raft_consensus.cc:482] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.750120 5485 raft_consensus.cc:504] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.750831 5485 leader_election.cc:288] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.751585 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e89240009304303a397175ca656c512" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.751806 5333 raft_consensus.cc:2454] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.752341 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e89240009304303a397175ca656c512" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.752507 5259 raft_consensus.cc:2454] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.752487 5373 leader_election.cc:302] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:23.753209 5485 raft_consensus.cc:2781] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.753307 5485 raft_consensus.cc:482] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.753371 5485 raft_consensus.cc:3037] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.754282 5449 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.754427 5449 ts_tablet_manager.cc:1367] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20240501 14:02:23.754515 5456 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.754616 5456 ts_tablet_manager.cc:1367] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20240501 14:02:23.755134 5449 raft_consensus.cc:348] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.755134 5456 raft_consensus.cc:348] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.755352 5449 raft_consensus.cc:374] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.755362 5456 raft_consensus.cc:374] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.755416 5449 raft_consensus.cc:729] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.755439 5456 raft_consensus.cc:729] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.755651 5456 consensus_queue.cc:260] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.755651 5449 consensus_queue.cc:260] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.756481 5456 ts_tablet_manager.cc:1398] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.756481 5449 ts_tablet_manager.cc:1398] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.756834 5456 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.756834 5449 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.758458 5449 tablet_bootstrap.cc:654] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.758458 5456 tablet_bootstrap.cc:654] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.761085 5470 raft_consensus.cc:482] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.761267 5470 raft_consensus.cc:504] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.762046 5470 leader_election.cc:288] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.762640 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.762873 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.763151 5298 leader_election.cc:341] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:23.763264 5299 leader_election.cc:341] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.763341 5299 leader_election.cc:302] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.763692 5470 raft_consensus.cc:2726] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.772814 5485 raft_consensus.cc:504] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.774401 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e89240009304303a397175ca656c512" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.774658 5259 raft_consensus.cc:3037] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.777886 5259 raft_consensus.cc:2454] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.778462 5373 leader_election.cc:302] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.778812 5452 raft_consensus.cc:2781] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.778995 5452 raft_consensus.cc:686] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:23.779434 5485 leader_election.cc:288] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.779323 5452 consensus_queue.cc:237] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.779723 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e89240009304303a397175ca656c512" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.779939 5333 raft_consensus.cc:3037] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.781404 5456 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.781579 5456 ts_tablet_manager.cc:1367] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.025s user 0.018s sys 0.005s
I20240501 14:02:23.782189 5333 raft_consensus.cc:2454] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.782352 5456 raft_consensus.cc:348] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.782603 5456 raft_consensus.cc:374] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.782661 5456 raft_consensus.cc:729] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.782894 5456 consensus_queue.cc:260] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.783524 5456 ts_tablet_manager.cc:1398] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.783669 5448 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.783849 5448 ts_tablet_manager.cc:1367] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.038s user 0.016s sys 0.014s
I20240501 14:02:23.784435 5456 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.784476 5448 raft_consensus.cc:348] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.784655 5448 raft_consensus.cc:374] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.784708 5448 raft_consensus.cc:729] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.784889 5448 consensus_queue.cc:260] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.785502 5448 ts_tablet_manager.cc:1398] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.785764 5448 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.785923 5456 tablet_bootstrap.cc:654] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.785835 5156 catalog_manager.cc:5484] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:23.787186 5448 tablet_bootstrap.cc:654] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.788005 5452 raft_consensus.cc:482] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.788146 5452 raft_consensus.cc:504] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.789202 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.789415 5259 raft_consensus.cc:2454] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.789832 5373 leader_election.cc:302] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.790102 5485 raft_consensus.cc:2781] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.790167 5485 raft_consensus.cc:482] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.790231 5485 raft_consensus.cc:3037] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.793238 5485 raft_consensus.cc:504] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.794333 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.794512 5259 raft_consensus.cc:3037] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.795096 5448 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.795245 5448 ts_tablet_manager.cc:1367] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240501 14:02:23.795882 5448 raft_consensus.cc:348] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.796085 5448 raft_consensus.cc:374] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.796207 5448 raft_consensus.cc:729] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.796435 5448 consensus_queue.cc:260] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.797053 5448 ts_tablet_manager.cc:1398] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.797205 5259 raft_consensus.cc:2454] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.797422 5448 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.797609 5373 leader_election.cc:302] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.797837 5455 raft_consensus.cc:2781] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.798023 5485 leader_election.cc:288] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.798622 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.798810 5333 raft_consensus.cc:3037] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.799121 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4e76b1ea74fe3a460dfb8fb802df6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.799662 5452 leader_election.cc:288] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.800849 5449 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.800992 5449 ts_tablet_manager.cc:1367] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.015s
I20240501 14:02:23.801188 5456 tablet_bootstrap.cc:492] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.801326 5456 ts_tablet_manager.cc:1367] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.008s
I20240501 14:02:23.801476 5333 raft_consensus.cc:2454] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.801678 5449 raft_consensus.cc:348] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.801851 5449 raft_consensus.cc:374] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.801908 5449 raft_consensus.cc:729] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.802161 5449 consensus_queue.cc:260] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.802636 5449 ts_tablet_manager.cc:1398] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.801908 5456 raft_consensus.cc:348] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.802868 5456 raft_consensus.cc:374] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.802919 5456 raft_consensus.cc:729] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.803006 5449 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.803099 5456 consensus_queue.cc:260] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.803534 5456 ts_tablet_manager.cc:1398] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.803807 5456 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.804476 5449 tablet_bootstrap.cc:654] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.805089 5456 tablet_bootstrap.cc:654] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.807677 5448 tablet_bootstrap.cc:654] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.813655 5452 raft_consensus.cc:482] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.813905 5452 raft_consensus.cc:504] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.814929 5448 tablet_bootstrap.cc:492] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.814975 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.815271 5259 raft_consensus.cc:2454] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.815085 5448 ts_tablet_manager.cc:1367] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20240501 14:02:23.815697 5373 leader_election.cc:302] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.816033 5485 raft_consensus.cc:2781] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.816226 5485 raft_consensus.cc:482] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.816368 5485 raft_consensus.cc:3037] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.816548 5448 raft_consensus.cc:348] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.816725 5448 raft_consensus.cc:374] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.816784 5448 raft_consensus.cc:729] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.818755 5448 consensus_queue.cc:260] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.819836 5448 ts_tablet_manager.cc:1398] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 14:02:23.819985 5452 leader_election.cc:288] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.820534 5485 raft_consensus.cc:504] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.820572 5449 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.820915 5449 ts_tablet_manager.cc:1367] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20240501 14:02:23.821774 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.821751 5449 raft_consensus.cc:348] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.822088 5449 raft_consensus.cc:374] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.822111 5259 raft_consensus.cc:3037] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.822183 5449 raft_consensus.cc:729] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.822491 5449 consensus_queue.cc:260] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.823139 5449 ts_tablet_manager.cc:1398] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.823578 5449 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.825616 5449 tablet_bootstrap.cc:654] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.828308 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.828670 5333 raft_consensus.cc:2454] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.830184 5455 raft_consensus.cc:686] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:23.830487 5455 consensus_queue.cc:237] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.830871 5259 raft_consensus.cc:2454] T 64a7a301cdf6415ea7e3654551f2ed91 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.831269 5373 leader_election.cc:302] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.831641 5485 leader_election.cc:288] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.832002 5448 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.833879 5449 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.834085 5448 tablet_bootstrap.cc:654] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.834131 5449 ts_tablet_manager.cc:1367] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240501 14:02:23.835201 5449 raft_consensus.cc:348] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.835551 5449 raft_consensus.cc:374] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.835654 5449 raft_consensus.cc:729] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.836081 5449 consensus_queue.cc:260] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.836144 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a7a301cdf6415ea7e3654551f2ed91" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.836453 5485 raft_consensus.cc:2781] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.836483 5333 raft_consensus.cc:3037] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.836570 5485 raft_consensus.cc:686] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:23.836838 5485 consensus_queue.cc:237] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.837266 5461 raft_consensus.cc:482] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.837393 5461 raft_consensus.cc:504] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.837970 5461 leader_election.cc:288] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.838673 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f3db9eff53e4ec29ab17081d32097a8" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.838831 5334 raft_consensus.cc:2454] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.838634 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f3db9eff53e4ec29ab17081d32097a8" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.839071 5407 raft_consensus.cc:2454] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.839406 5333 raft_consensus.cc:2454] T 64a7a301cdf6415ea7e3654551f2ed91 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.839464 5223 leader_election.cc:302] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.839710 5461 raft_consensus.cc:2781] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.839774 5461 raft_consensus.cc:482] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.839829 5461 raft_consensus.cc:3037] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.840291 5470 raft_consensus.cc:482] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.840430 5470 raft_consensus.cc:504] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.841080 5470 leader_election.cc:288] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.841830 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2428cca58742fabb9a656f90ce5b47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.842074 5456 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.842052 5259 raft_consensus.cc:2454] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:23.842257 5456 ts_tablet_manager.cc:1367] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.033s
I20240501 14:02:23.842512 5299 leader_election.cc:302] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.842546 5461 raft_consensus.cc:504] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.842809 5470 raft_consensus.cc:2781] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.842887 5470 raft_consensus.cc:482] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.842944 5470 raft_consensus.cc:3037] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.843153 5456 raft_consensus.cc:348] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.843328 5456 raft_consensus.cc:374] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.843380 5456 raft_consensus.cc:729] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.843570 5456 consensus_queue.cc:260] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.843807 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2428cca58742fabb9a656f90ce5b47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.844002 5408 raft_consensus.cc:2454] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:23.844158 5456 ts_tablet_manager.cc:1398] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.844482 5456 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.845657 5470 raft_consensus.cc:504] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.846295 5456 tablet_bootstrap.cc:654] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.846804 5470 leader_election.cc:288] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.847508 5449 ts_tablet_manager.cc:1398] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20240501 14:02:23.847898 5477 raft_consensus.cc:482] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.848304 5449 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.848469 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f3db9eff53e4ec29ab17081d32097a8" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:23.848686 5407 raft_consensus.cc:3037] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.850700 5449 tablet_bootstrap.cc:654] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.848111 5477 raft_consensus.cc:504] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.853283 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2428cca58742fabb9a656f90ce5b47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:23.856607 5455 raft_consensus.cc:482] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.856875 5455 raft_consensus.cc:504] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.859705 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2428cca58742fabb9a656f90ce5b47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.865171 5461 leader_election.cc:288] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.866170 5455 leader_election.cc:288] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.866497 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.866835 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.867894 5407 raft_consensus.cc:2454] T 3f3db9eff53e4ec29ab17081d32097a8 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:23.869112 5477 leader_election.cc:288] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.869395 5156 catalog_manager.cc:5484] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:23.869843 5408 raft_consensus.cc:3037] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.872725 5259 raft_consensus.cc:3037] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.875846 5259 raft_consensus.cc:2454] T 6a2428cca58742fabb9a656f90ce5b47 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:23.876672 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.877580 5258 raft_consensus.cc:2454] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.878608 5373 leader_election.cc:302] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.879890 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.881132 5406 raft_consensus.cc:2454] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.882205 5455 raft_consensus.cc:2781] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.882404 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f3db9eff53e4ec29ab17081d32097a8" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.882751 5455 raft_consensus.cc:482] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.882879 5455 raft_consensus.cc:3037] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.883471 5408 raft_consensus.cc:2454] T 6a2428cca58742fabb9a656f90ce5b47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:23.884974 5223 leader_election.cc:302] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.885429 5223 leader_election.cc:302] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.885916 5333 raft_consensus.cc:3037] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.886507 5299 leader_election.cc:302] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.886972 5449 tablet_bootstrap.cc:492] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.887202 5449 ts_tablet_manager.cc:1367] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.003s
I20240501 14:02:23.891698 5477 raft_consensus.cc:2781] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.892076 5461 raft_consensus.cc:2781] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.892138 5470 raft_consensus.cc:2781] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.892269 5334 raft_consensus.cc:2454] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.892563 5461 raft_consensus.cc:686] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:23.892916 5461 consensus_queue.cc:237] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.894492 5455 raft_consensus.cc:504] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.897333 5156 catalog_manager.cc:5484] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:23.899900 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:23.900575 5455 leader_election.cc:288] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.901245 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.901479 5334 raft_consensus.cc:3037] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.904446 5476 raft_consensus.cc:482] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.904459 5334 raft_consensus.cc:2454] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:23.904702 5476 raft_consensus.cc:504] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.905009 5373 leader_election.cc:302] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:23.905397 5455 raft_consensus.cc:2781] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.905478 5476 leader_election.cc:288] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.905570 5455 raft_consensus.cc:686] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:23.905896 5455 consensus_queue.cc:237] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.906508 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.906755 5408 raft_consensus.cc:2454] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.907195 5223 leader_election.cc:302] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.907529 5476 raft_consensus.cc:2781] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.907632 5476 raft_consensus.cc:482] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.907756 5476 raft_consensus.cc:3037] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.907958 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.908341 5334 raft_consensus.cc:2454] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:23.910849 5333 raft_consensus.cc:2454] T 3f3db9eff53e4ec29ab17081d32097a8 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:23.910816 5476 raft_consensus.cc:504] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.911139 5477 raft_consensus.cc:482] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.911274 5477 raft_consensus.cc:3037] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.911520 5448 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.911726 5448 ts_tablet_manager.cc:1367] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.080s user 0.044s sys 0.023s
I20240501 14:02:23.912004 5476 leader_election.cc:288] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.907748 5456 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.912878 5456 ts_tablet_manager.cc:1367] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.068s user 0.017s sys 0.037s
I20240501 14:02:23.912747 5448 raft_consensus.cc:348] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.913040 5448 raft_consensus.cc:374] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.913141 5448 raft_consensus.cc:729] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.913496 5448 consensus_queue.cc:260] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.913729 5456 raft_consensus.cc:348] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.913960 5456 raft_consensus.cc:374] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.914029 5477 raft_consensus.cc:504] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.914199 5448 ts_tablet_manager.cc:1398] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.914588 5448 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.914731 5477 leader_election.cc:288] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.916450 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:23.916586 5258 raft_consensus.cc:2379] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b5d87b866b04909a7d8d16ea5b25483 in current term 1: Already voted for candidate bc68bd81bd5144d9bbcde254c8963fdc in this term.
I20240501 14:02:23.916450 5448 tablet_bootstrap.cc:654] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.916985 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.917071 5470 raft_consensus.cc:686] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:23.917188 5333 raft_consensus.cc:3037] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.917410 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b471619f7e3a41f280b47e269eb9afd4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:23.917584 5408 raft_consensus.cc:3037] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.920011 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40017157bdb9475585d127bf93668562" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:23.920938 5334 raft_consensus.cc:2379] T 40017157bdb9475585d127bf93668562 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:23.914049 5456 raft_consensus.cc:729] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.924597 5333 raft_consensus.cc:2454] T b471619f7e3a41f280b47e269eb9afd4 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:23.924986 5470 consensus_queue.cc:237] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.925354 5449 raft_consensus.cc:348] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.925563 5449 raft_consensus.cc:374] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.926239 5448 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.926182 5156 catalog_manager.cc:5484] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:23.926420 5448 ts_tablet_manager.cc:1367] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20240501 14:02:23.926416 5157 catalog_manager.cc:5484] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:23.927429 5448 raft_consensus.cc:348] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.927597 5448 raft_consensus.cc:374] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.927690 5448 raft_consensus.cc:729] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.927953 5448 consensus_queue.cc:260] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.928440 5448 ts_tablet_manager.cc:1398] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.928756 5448 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.930253 5448 tablet_bootstrap.cc:654] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.931100 5408 raft_consensus.cc:2454] T b471619f7e3a41f280b47e269eb9afd4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:23.931159 5224 leader_election.cc:302] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.931622 5224 leader_election.cc:302] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:23.931893 5449 raft_consensus.cc:729] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.931947 5477 raft_consensus.cc:2726] T 40017157bdb9475585d127bf93668562 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.932142 5477 raft_consensus.cc:2781] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:23.932337 5477 raft_consensus.cc:686] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:23.932397 5521 raft_consensus.cc:482] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.932535 5521 raft_consensus.cc:504] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.932622 5477 consensus_queue.cc:237] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.932946 5157 catalog_manager.cc:5484] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:23.933682 5521 leader_election.cc:288] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.932145 5449 consensus_queue.cc:260] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.932334 5456 consensus_queue.cc:260] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.934291 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.934756 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.935024 5298 leader_election.cc:341] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:23.935273 5299 leader_election.cc:341] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.935427 5299 leader_election.cc:302] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.934317 5449 ts_tablet_manager.cc:1398] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20240501 14:02:23.936061 5449 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.936244 5448 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.936414 5448 ts_tablet_manager.cc:1367] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240501 14:02:23.937233 5448 raft_consensus.cc:348] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.937510 5448 raft_consensus.cc:374] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.937587 5448 raft_consensus.cc:729] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.937469 5156 catalog_manager.cc:5484] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:23.937955 5449 tablet_bootstrap.cc:654] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.937856 5448 consensus_queue.cc:260] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.938453 5448 ts_tablet_manager.cc:1398] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:23.938542 5470 raft_consensus.cc:2726] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.938727 5470 raft_consensus.cc:482] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.938845 5448 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.938861 5470 raft_consensus.cc:504] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.939795 5470 leader_election.cc:288] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.940532 5448 tablet_bootstrap.cc:654] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.940622 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.941378 5456 ts_tablet_manager.cc:1398] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
W20240501 14:02:23.942118 5298 leader_election.cc:341] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.942605 5456 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.942807 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.943475 5299 leader_election.cc:341] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.943646 5299 leader_election.cc:302] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.944317 5470 raft_consensus.cc:2726] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.944342 5456 tablet_bootstrap.cc:654] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.947504 5477 raft_consensus.cc:482] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.947665 5477 raft_consensus.cc:504] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.948778 5449 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:23.948671 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.949000 5477 leader_election.cc:288] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.949256 5449 ts_tablet_manager.cc:1367] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
W20240501 14:02:23.949517 5224 leader_election.cc:341] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.949573 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:23.950017 5456 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
W20240501 14:02:23.950068 5223 leader_election.cc:341] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.950140 5456 ts_tablet_manager.cc:1367] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20240501 14:02:23.950225 5223 leader_election.cc:302] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.950183 5449 raft_consensus.cc:348] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.950403 5449 raft_consensus.cc:374] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.950481 5449 raft_consensus.cc:729] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.950779 5477 raft_consensus.cc:2726] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.950762 5449 consensus_queue.cc:260] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.950783 5456 raft_consensus.cc:348] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.950973 5456 raft_consensus.cc:374] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.951064 5456 raft_consensus.cc:729] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.951301 5449 ts_tablet_manager.cc:1398] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:23.948814 5448 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.951278 5456 consensus_queue.cc:260] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.951503 5448 ts_tablet_manager.cc:1367] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20240501 14:02:23.951774 5456 ts_tablet_manager.cc:1398] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.952085 5456 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.952286 5448 raft_consensus.cc:348] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.952569 5449 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.952571 5448 raft_consensus.cc:374] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.952747 5448 raft_consensus.cc:729] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.952986 5448 consensus_queue.cc:260] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.953512 5448 ts_tablet_manager.cc:1398] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:23.953868 5448 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.953910 5456 tablet_bootstrap.cc:654] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.954630 5449 tablet_bootstrap.cc:654] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.955446 5448 tablet_bootstrap.cc:654] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.965917 5456 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:23.965895 5455 raft_consensus.cc:482] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.966202 5455 raft_consensus.cc:504] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.966835 5456 ts_tablet_manager.cc:1367] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.005s
I20240501 14:02:23.966977 5455 leader_election.cc:288] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.967816 5456 raft_consensus.cc:348] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.967849 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.968442 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.968526 5449 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
W20240501 14:02:23.968546 5373 leader_election.cc:341] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.968772 5449 ts_tablet_manager.cc:1367] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.008s
I20240501 14:02:23.968777 5258 raft_consensus.cc:2454] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:23.968827 5456 raft_consensus.cc:374] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.969324 5373 leader_election.cc:302] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:23.969399 5456 raft_consensus.cc:729] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.969851 5455 raft_consensus.cc:2781] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:23.969776 5449 raft_consensus.cc:348] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.969808 5456 consensus_queue.cc:260] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.969950 5455 raft_consensus.cc:482] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:23.969992 5449 raft_consensus.cc:374] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.970065 5455 raft_consensus.cc:3037] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:23.970093 5449 raft_consensus.cc:729] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.970423 5448 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.970314 5449 consensus_queue.cc:260] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.970614 5448 ts_tablet_manager.cc:1367] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20240501 14:02:23.970932 5449 ts_tablet_manager.cc:1398] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:23.971300 5449 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:23.971376 5448 raft_consensus.cc:348] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.971575 5448 raft_consensus.cc:374] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.971654 5448 raft_consensus.cc:729] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.971696 5456 ts_tablet_manager.cc:1398] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 14:02:23.972002 5456 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:23.971920 5448 consensus_queue.cc:260] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.973197 5449 tablet_bootstrap.cc:654] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.973398 5448 ts_tablet_manager.cc:1398] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:23.973748 5448 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:23.973755 5456 tablet_bootstrap.cc:654] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.975106 5521 raft_consensus.cc:482] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.975320 5521 raft_consensus.cc:504] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.975523 5448 tablet_bootstrap.cc:654] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.976115 5521 leader_election.cc:288] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:23.977102 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:23.977594 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:23.978153 5298 leader_election.cc:341] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:23.978533 5299 leader_election.cc:341] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.978688 5299 leader_election.cc:302] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.980794 5521 raft_consensus.cc:2726] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.984050 5448 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.984298 5448 ts_tablet_manager.cc:1367] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20240501 14:02:23.985252 5448 raft_consensus.cc:348] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.985502 5448 raft_consensus.cc:374] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:23.985595 5448 raft_consensus.cc:729] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:23.985893 5448 consensus_queue.cc:260] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.989708 5448 ts_tablet_manager.cc:1398] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 14:02:23.991174 5511 raft_consensus.cc:482] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:23.991400 5511 raft_consensus.cc:504] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.992307 5511 leader_election.cc:288] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:23.993170 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:23.993800 5373 leader_election.cc:341] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.994486 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:23.994792 5448 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
W20240501 14:02:23.995115 5373 leader_election.cc:341] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:23.995255 5373 leader_election.cc:302] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:23.995807 5511 raft_consensus.cc:2726] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:23.996882 5448 tablet_bootstrap.cc:654] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:23.996814 5455 raft_consensus.cc:504] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:23.999328 5448 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:23.999536 5448 ts_tablet_manager.cc:1367] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 14:02:24.000140 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.000413 5258 raft_consensus.cc:3037] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.000466 5448 raft_consensus.cc:348] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.000725 5448 raft_consensus.cc:374] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.000808 5448 raft_consensus.cc:729] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.001124 5448 consensus_queue.cc:260] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.003649 5258 raft_consensus.cc:2454] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.004369 5373 leader_election.cc:302] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.004822 5511 raft_consensus.cc:2781] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.004987 5511 raft_consensus.cc:686] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.005331 5511 consensus_queue.cc:237] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.007597 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:24.008281 5373 leader_election.cc:341] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.008569 5455 leader_election.cc:288] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.004835 5448 ts_tablet_manager.cc:1398] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240501 14:02:24.008867 5154 catalog_manager.cc:5484] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.009586 5448 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.009923 5477 raft_consensus.cc:482] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.010073 5477 raft_consensus.cc:504] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.010731 5477 leader_election.cc:288] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.011305 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.011530 5408 raft_consensus.cc:2454] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.011797 5448 tablet_bootstrap.cc:654] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.012281 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.012487 5333 raft_consensus.cc:2454] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.012918 5223 leader_election.cc:302] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.013178 5461 raft_consensus.cc:482] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.013365 5461 raft_consensus.cc:504] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.013610 5477 raft_consensus.cc:2781] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.013751 5477 raft_consensus.cc:482] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.013851 5477 raft_consensus.cc:3037] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.013968 5461 leader_election.cc:288] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.014468 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.014693 5408 raft_consensus.cc:2454] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.015110 5223 leader_election.cc:302] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.015408 5461 raft_consensus.cc:2781] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.015517 5461 raft_consensus.cc:482] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.015627 5461 raft_consensus.cc:3037] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.016970 5477 raft_consensus.cc:504] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.017570 5477 leader_election.cc:288] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.018007 5448 tablet_bootstrap.cc:492] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.018110 5461 raft_consensus.cc:504] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.018236 5448 ts_tablet_manager.cc:1367] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20240501 14:02:24.018361 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.018572 5333 raft_consensus.cc:2454] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.018849 5456 tablet_bootstrap.cc:492] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.018914 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.019017 5456 ts_tablet_manager.cc:1367] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.047s user 0.023s sys 0.015s
I20240501 14:02:24.019112 5334 raft_consensus.cc:3037] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.019657 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.019726 5456 raft_consensus.cc:348] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.019922 5333 raft_consensus.cc:3037] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.019956 5456 raft_consensus.cc:374] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.020061 5456 raft_consensus.cc:729] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.019655 5448 raft_consensus.cc:348] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.020318 5448 raft_consensus.cc:374] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.020350 5456 consensus_queue.cc:260] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.020469 5448 raft_consensus.cc:729] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.020804 5448 consensus_queue.cc:260] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.021531 5448 ts_tablet_manager.cc:1398] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 14:02:24.021893 5448 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.022087 5334 raft_consensus.cc:2454] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.022564 5333 raft_consensus.cc:2454] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.019693 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b0d70a8e37426e8e6f7d11501a1ed1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.023226 5408 raft_consensus.cc:3037] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.023537 5224 leader_election.cc:302] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.024262 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07d904a12cde4e98a7f409f7f0868eae" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.024663 5456 ts_tablet_manager.cc:1398] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 14:02:24.024834 5477 raft_consensus.cc:2781] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.024976 5477 raft_consensus.cc:686] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.025256 5477 consensus_queue.cc:237] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.025645 5449 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.025830 5449 ts_tablet_manager.cc:1367] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.055s user 0.027s sys 0.015s
I20240501 14:02:24.025945 5456 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.026297 5408 raft_consensus.cc:2454] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.024695 5461 leader_election.cc:288] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.027686 5456 tablet_bootstrap.cc:654] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.028352 5449 raft_consensus.cc:348] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.028578 5449 raft_consensus.cc:374] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.028782 5449 raft_consensus.cc:729] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.029088 5449 consensus_queue.cc:260] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.029767 5224 leader_election.cc:302] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.030088 5406 raft_consensus.cc:3037] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.030946 5449 ts_tablet_manager.cc:1398] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 14:02:24.031334 5449 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.032084 5448 tablet_bootstrap.cc:654] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.033308 5406 raft_consensus.cc:2454] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.033393 5449 tablet_bootstrap.cc:654] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.033910 5476 raft_consensus.cc:2781] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.036767 5521 raft_consensus.cc:482] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.036978 5521 raft_consensus.cc:504] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.037726 5521 leader_election.cc:288] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.038604 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcc64e86378485cb6231e2ec17a533b" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.038834 5258 raft_consensus.cc:2454] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.039263 5299 leader_election.cc:302] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.039423 5449 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.039569 5521 raft_consensus.cc:2781] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.039683 5521 raft_consensus.cc:482] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.039774 5521 raft_consensus.cc:3037] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.040408 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcc64e86378485cb6231e2ec17a533b" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.040556 5461 raft_consensus.cc:482] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.040622 5406 raft_consensus.cc:2454] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.039587 5449 ts_tablet_manager.cc:1367] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240501 14:02:24.040747 5461 raft_consensus.cc:504] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.041607 5449 raft_consensus.cc:348] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.041821 5449 raft_consensus.cc:374] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.041927 5449 raft_consensus.cc:729] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.042224 5449 consensus_queue.cc:260] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.042572 5461 leader_election.cc:288] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.042536 5521 raft_consensus.cc:504] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.042806 5449 ts_tablet_manager.cc:1398] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.043530 5456 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.043720 5456 ts_tablet_manager.cc:1367] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.004s
I20240501 14:02:24.044276 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcc64e86378485cb6231e2ec17a533b" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.044474 5258 raft_consensus.cc:3037] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.044524 5456 raft_consensus.cc:348] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.044732 5456 raft_consensus.cc:374] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.044821 5456 raft_consensus.cc:729] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.045065 5456 consensus_queue.cc:260] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.045590 5456 ts_tablet_manager.cc:1398] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.045915 5456 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.046057 5461 raft_consensus.cc:482] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.046280 5461 raft_consensus.cc:504] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.047156 5461 leader_election.cc:288] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.047302 5258 raft_consensus.cc:2454] T dbcc64e86378485cb6231e2ec17a533b P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.047637 5449 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.047677 5456 tablet_bootstrap.cc:654] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.047775 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.048012 5333 raft_consensus.cc:2454] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.048864 5476 raft_consensus.cc:686] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.048892 5224 leader_election.cc:302] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.049172 5476 consensus_queue.cc:237] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.049451 5299 leader_election.cc:302] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.049777 5470 raft_consensus.cc:2781] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.049858 5449 tablet_bootstrap.cc:654] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.049959 5470 raft_consensus.cc:686] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.050282 5470 consensus_queue.cc:237] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.051494 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfffbd2bdae64276afa3b5b5ca7fd5d4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.051762 5333 raft_consensus.cc:2454] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.052693 5224 leader_election.cc:302] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.053084 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.053292 5157 catalog_manager.cc:5484] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
W20240501 14:02:24.053620 5223 leader_election.cc:341] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.054112 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfffbd2bdae64276afa3b5b5ca7fd5d4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:24.054625 5223 leader_election.cc:341] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.054778 5477 raft_consensus.cc:2781] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.054941 5477 raft_consensus.cc:482] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.055083 5477 raft_consensus.cc:3037] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.057513 5154 catalog_manager.cc:5484] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.057858 5477 raft_consensus.cc:504] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.058985 5477 leader_election.cc:288] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.059249 5156 catalog_manager.cc:5484] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.059247 5477 raft_consensus.cc:2781] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.060441 5477 raft_consensus.cc:482] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.060633 5448 tablet_bootstrap.cc:492] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.060608 5477 raft_consensus.cc:3037] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.060806 5448 ts_tablet_manager.cc:1367] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.005s
I20240501 14:02:24.061959 5448 raft_consensus.cc:348] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.062184 5334 raft_consensus.cc:3037] T 74d215cf27a64fd985b0ac7b292017f9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.062604 5525 raft_consensus.cc:482] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.062191 5448 raft_consensus.cc:374] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.062939 5470 raft_consensus.cc:482] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.062965 5448 raft_consensus.cc:729] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.063256 5525 raft_consensus.cc:504] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.064380 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.064381 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:24.065165 5223 leader_election.cc:341] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.065241 5476 raft_consensus.cc:482] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.065376 5476 raft_consensus.cc:504] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.066505 5525 leader_election.cc:288] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.066643 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.067272 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.067281 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.067353 5470 raft_consensus.cc:504] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.067523 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbcc64e86378485cb6231e2ec17a533b" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.067847 5333 raft_consensus.cc:3037] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.067322 5406 raft_consensus.cc:2454] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.068598 5332 raft_consensus.cc:2454] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.068708 5298 leader_election.cc:302] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.069216 5525 raft_consensus.cc:2781] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.069181 5224 leader_election.cc:302] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.069222 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.069377 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.069495 5259 raft_consensus.cc:2454] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.069569 5407 raft_consensus.cc:2454] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.069905 5299 leader_election.cc:302] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.069495 5461 consensus_queue.cc:1035] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 14:02:24.069892 5477 raft_consensus.cc:504] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.070370 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.070607 5406 raft_consensus.cc:2454] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.070381 5470 leader_election.cc:288] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.070940 5470 raft_consensus.cc:2781] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.071023 5470 raft_consensus.cc:482] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.071128 5470 raft_consensus.cc:3037] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.071748 5461 raft_consensus.cc:2781] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.071861 5461 raft_consensus.cc:482] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.071972 5461 raft_consensus.cc:3037] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.072542 5333 raft_consensus.cc:2454] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.073058 5224 leader_election.cc:302] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483
I20240501 14:02:24.074021 5470 raft_consensus.cc:504] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.075716 5449 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.075851 5258 raft_consensus.cc:2454] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.076279 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.079701 5476 leader_election.cc:288] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.079737 5449 ts_tablet_manager.cc:1367] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20240501 14:02:24.079666 5470 leader_election.cc:288] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.081315 5521 leader_election.cc:288] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.081526 5525 raft_consensus.cc:482] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.081661 5525 raft_consensus.cc:3037] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.085184 5525 raft_consensus.cc:504] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.086764 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.087843 5456 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.088145 5525 leader_election.cc:288] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.088228 5543 raft_consensus.cc:2781] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.088307 5448 consensus_queue.cc:260] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.088457 5543 raft_consensus.cc:686] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.090793 5408 raft_consensus.cc:3037] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.091493 5476 consensus_queue.cc:1035] T 74d215cf27a64fd985b0ac7b292017f9 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 14:02:24.091675 5448 ts_tablet_manager.cc:1398] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20240501 14:02:24.091699 5477 leader_election.cc:288] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.091507 5543 consensus_queue.cc:237] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.093722 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfffbd2bdae64276afa3b5b5ca7fd5d4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.093741 5461 raft_consensus.cc:504] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.093955 5333 raft_consensus.cc:3037] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.091603 5456 ts_tablet_manager.cc:1367] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.012s
I20240501 14:02:24.095907 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.096143 5407 raft_consensus.cc:3037] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.097820 5448 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.098315 5408 raft_consensus.cc:2454] T dbcc64e86378485cb6231e2ec17a533b P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.099792 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccc815b1d356477ab81ea553e21f208a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.099995 5449 raft_consensus.cc:348] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.100370 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfffbd2bdae64276afa3b5b5ca7fd5d4" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.100955 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.102308 5259 raft_consensus.cc:3037] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.104324 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d6cd1be8584b9281251bbf29f19c39" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.104573 5258 raft_consensus.cc:2379] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate bc68bd81bd5144d9bbcde254c8963fdc in this term.
I20240501 14:02:24.104733 5449 raft_consensus.cc:374] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.104923 5449 raft_consensus.cc:729] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.105175 5449 consensus_queue.cc:260] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.105738 5449 ts_tablet_manager.cc:1398] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20240501 14:02:24.104849 5407 raft_consensus.cc:2454] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.105844 5332 raft_consensus.cc:2379] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:24.106441 5461 leader_election.cc:288] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.106292 5298 leader_election.cc:302] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.106894 5448 tablet_bootstrap.cc:654] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.107017 5406 raft_consensus.cc:3037] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.107843 5449 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.108340 5259 raft_consensus.cc:2454] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.107017 5525 raft_consensus.cc:2781] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.108515 5525 raft_consensus.cc:686] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.108758 5525 consensus_queue.cc:237] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
W20240501 14:02:24.102569 5223 leader_election.cc:341] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.112592 5223 leader_election.cc:302] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.113747 5456 raft_consensus.cc:348] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.113950 5456 raft_consensus.cc:374] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.114005 5456 raft_consensus.cc:729] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.114180 5456 consensus_queue.cc:260] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.116216 5543 raft_consensus.cc:2726] T 18d6cd1be8584b9281251bbf29f19c39 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.116842 5449 tablet_bootstrap.cc:654] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.117169 5157 catalog_manager.cc:5484] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.117937 5456 ts_tablet_manager.cc:1398] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20240501 14:02:24.118245 5456 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.120412 5448 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.120565 5448 ts_tablet_manager.cc:1367] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20240501 14:02:24.121387 5456 tablet_bootstrap.cc:654] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.125169 5448 raft_consensus.cc:348] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.125403 5448 raft_consensus.cc:374] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.125464 5448 raft_consensus.cc:729] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.125660 5448 consensus_queue.cc:260] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.126165 5448 ts_tablet_manager.cc:1398] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 14:02:24.126451 5448 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.128242 5406 raft_consensus.cc:2454] T 18d6cd1be8584b9281251bbf29f19c39 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.128713 5298 leader_election.cc:302] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.129274 5550 raft_consensus.cc:2781] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.129415 5550 raft_consensus.cc:686] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.129688 5550 consensus_queue.cc:237] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.130437 5448 tablet_bootstrap.cc:654] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.133319 5333 raft_consensus.cc:2454] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.133894 5224 leader_election.cc:302] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483
I20240501 14:02:24.134359 5543 raft_consensus.cc:2781] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.134454 5543 raft_consensus.cc:686] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.134683 5543 consensus_queue.cc:237] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.135684 5449 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.135824 5449 ts_tablet_manager.cc:1367] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.007s
I20240501 14:02:24.136648 5449 raft_consensus.cc:348] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.136847 5449 raft_consensus.cc:374] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.136900 5449 raft_consensus.cc:729] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.137125 5449 consensus_queue.cc:260] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.137733 5448 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.137954 5448 ts_tablet_manager.cc:1367] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.003s
I20240501 14:02:24.138288 5157 catalog_manager.cc:5484] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.137749 5449 ts_tablet_manager.cc:1398] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:24.138847 5449 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.138950 5448 raft_consensus.cc:348] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.139190 5448 raft_consensus.cc:374] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.139282 5448 raft_consensus.cc:729] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.139552 5448 consensus_queue.cc:260] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.140280 5449 tablet_bootstrap.cc:654] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.143234 5448 ts_tablet_manager.cc:1398] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 14:02:24.144791 5448 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.144714 5156 catalog_manager.cc:5484] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.146746 5448 tablet_bootstrap.cc:654] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.155884 5456 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.156103 5456 ts_tablet_manager.cc:1367] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.011s
I20240501 14:02:24.157060 5456 raft_consensus.cc:348] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.157325 5456 raft_consensus.cc:374] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.157375 5456 raft_consensus.cc:729] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.157594 5456 consensus_queue.cc:260] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.158187 5456 ts_tablet_manager.cc:1398] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:24.158555 5456 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.159610 5156 catalog_manager.cc:5484] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.160305 5456 tablet_bootstrap.cc:654] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.167213 5448 tablet_bootstrap.cc:492] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.167389 5449 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.167541 5449 ts_tablet_manager.cc:1367] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.014s
I20240501 14:02:24.167567 5448 ts_tablet_manager.cc:1367] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.005s
I20240501 14:02:24.168251 5456 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.168239 5449 raft_consensus.cc:348] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.168406 5456 ts_tablet_manager.cc:1367] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240501 14:02:24.168437 5449 raft_consensus.cc:374] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.168318 5448 raft_consensus.cc:348] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.168501 5449 raft_consensus.cc:729] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.168550 5448 raft_consensus.cc:374] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.168620 5448 raft_consensus.cc:729] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.168751 5449 consensus_queue.cc:260] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.168843 5448 consensus_queue.cc:260] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.169005 5456 raft_consensus.cc:348] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.169147 5456 raft_consensus.cc:374] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.169194 5456 raft_consensus.cc:729] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.169464 5448 ts_tablet_manager.cc:1398] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.169391 5456 consensus_queue.cc:260] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.169715 5448 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.171356 5456 ts_tablet_manager.cc:1398] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:24.171375 5449 ts_tablet_manager.cc:1398] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:24.171634 5456 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.171658 5449 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.172235 5485 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.173740 5448 tablet_bootstrap.cc:654] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.174172 5455 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.176642 5448 tablet_bootstrap.cc:492] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.176793 5448 ts_tablet_manager.cc:1367] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240501 14:02:24.177501 5448 raft_consensus.cc:348] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.177706 5448 raft_consensus.cc:374] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.177754 5448 raft_consensus.cc:729] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.177994 5456 tablet_bootstrap.cc:654] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.177999 5449 tablet_bootstrap.cc:654] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.177989 5448 consensus_queue.cc:260] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.184551 5448 ts_tablet_manager.cc:1398] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240501 14:02:24.184859 5448 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.186260 5448 tablet_bootstrap.cc:654] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.191946 5448 tablet_bootstrap.cc:492] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.192101 5448 ts_tablet_manager.cc:1367] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240501 14:02:24.192219 5449 tablet_bootstrap.cc:492] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.192420 5449 ts_tablet_manager.cc:1367] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.006s
I20240501 14:02:24.192848 5456 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.192982 5456 ts_tablet_manager.cc:1367] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.021s user 0.013s sys 0.000s
I20240501 14:02:24.192881 5448 raft_consensus.cc:348] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.192927 5449 raft_consensus.cc:348] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.193056 5448 raft_consensus.cc:374] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.193107 5449 raft_consensus.cc:374] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.193109 5448 raft_consensus.cc:729] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.193197 5449 raft_consensus.cc:729] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.193465 5449 consensus_queue.cc:260] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.193436 5448 consensus_queue.cc:260] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.193645 5456 raft_consensus.cc:348] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.193789 5456 raft_consensus.cc:374] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.193835 5456 raft_consensus.cc:729] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.193992 5448 ts_tablet_manager.cc:1398] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.194034 5449 ts_tablet_manager.cc:1398] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.194025 5456 consensus_queue.cc:260] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.194248 5448 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.194413 5449 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.195652 5456 ts_tablet_manager.cc:1398] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:24.195772 5448 tablet_bootstrap.cc:654] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.195776 5449 tablet_bootstrap.cc:654] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.195932 5456 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.197422 5456 tablet_bootstrap.cc:654] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.201640 5543 raft_consensus.cc:482] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.201851 5543 raft_consensus.cc:504] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.202620 5543 leader_election.cc:288] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.203552 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.203766 5404 raft_consensus.cc:2454] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.204227 5223 leader_election.cc:302] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.204843 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.205039 5333 raft_consensus.cc:2454] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.205672 5543 raft_consensus.cc:2781] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.205760 5543 raft_consensus.cc:482] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.205821 5543 raft_consensus.cc:3037] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.208648 5543 raft_consensus.cc:504] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.208854 5448 tablet_bootstrap.cc:492] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.208986 5448 ts_tablet_manager.cc:1367] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.007s
I20240501 14:02:24.209259 5449 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.209445 5449 ts_tablet_manager.cc:1367] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.011s
I20240501 14:02:24.209733 5448 raft_consensus.cc:348] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.209738 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.209986 5448 raft_consensus.cc:374] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.210117 5333 raft_consensus.cc:3037] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.210153 5448 raft_consensus.cc:729] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.209983 5449 raft_consensus.cc:348] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.210420 5449 raft_consensus.cc:374] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.210534 5449 raft_consensus.cc:729] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.210500 5448 consensus_queue.cc:260] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.210775 5449 consensus_queue.cc:260] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.211169 5448 ts_tablet_manager.cc:1398] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.211577 5448 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.213104 5333 raft_consensus.cc:2454] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.213145 5449 ts_tablet_manager.cc:1398] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 14:02:24.213164 5448 tablet_bootstrap.cc:654] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.213549 5449 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.213627 5224 leader_election.cc:302] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.213866 5452 raft_consensus.cc:482] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.214030 5452 raft_consensus.cc:504] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.214578 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ba525391dc4e00bdbc841f4eeead11" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.214666 5452 leader_election.cc:288] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.214780 5404 raft_consensus.cc:3037] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.214915 5449 tablet_bootstrap.cc:654] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.213886 5461 raft_consensus.cc:2781] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.215350 5461 raft_consensus.cc:686] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.215646 5461 consensus_queue.cc:237] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.218508 5404 raft_consensus.cc:2454] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.219090 5452 raft_consensus.cc:482] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.219236 5452 raft_consensus.cc:504] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.219617 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.219868 5452 leader_election.cc:288] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.220158 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4fdc2cf86a44348638047a20860698" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.220434 5333 raft_consensus.cc:2379] T bc4fdc2cf86a44348638047a20860698 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b5d87b866b04909a7d8d16ea5b25483 in current term 1: Already voted for candidate bc68bd81bd5144d9bbcde254c8963fdc in this term.
I20240501 14:02:24.220438 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26da6c9b322432f934b1de3669f0646" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.220710 5543 leader_election.cc:288] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
W20240501 14:02:24.221284 5373 leader_election.cc:341] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.221952 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26da6c9b322432f934b1de3669f0646" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.222510 5448 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.222528 5258 raft_consensus.cc:2454] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.222705 5448 ts_tablet_manager.cc:1367] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240501 14:02:24.223582 5373 leader_election.cc:302] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.224660 5452 raft_consensus.cc:3037] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.225227 5448 raft_consensus.cc:348] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.225481 5448 raft_consensus.cc:374] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.226260 5448 raft_consensus.cc:729] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.226563 5448 consensus_queue.cc:260] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.227438 5373 leader_election.cc:302] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.227515 5448 ts_tablet_manager.cc:1398] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:24.227739 5511 raft_consensus.cc:2781] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.227855 5456 tablet_bootstrap.cc:492] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.228103 5511 raft_consensus.cc:482] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.228456 5448 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.228256 5157 catalog_manager.cc:5484] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.228266 5511 raft_consensus.cc:3037] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.228101 5456 ts_tablet_manager.cc:1367] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20240501 14:02:24.229801 5456 raft_consensus.cc:348] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.230908 5456 raft_consensus.cc:374] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.231993 5456 raft_consensus.cc:729] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.231988 5452 raft_consensus.cc:2726] T bc4fdc2cf86a44348638047a20860698 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.232651 5456 consensus_queue.cc:260] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.233180 5456 ts_tablet_manager.cc:1398] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:24.233464 5456 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.233506 5543 raft_consensus.cc:482] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.233659 5543 raft_consensus.cc:504] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.234301 5543 leader_election.cc:288] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.234508 5476 raft_consensus.cc:482] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.234660 5476 raft_consensus.cc:504] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.234664 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "911e80bff52f48abaea33317a9244f38" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.234774 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "911e80bff52f48abaea33317a9244f38" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.235014 5332 raft_consensus.cc:2454] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.235044 5404 raft_consensus.cc:2454] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.235275 5476 leader_election.cc:288] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.235574 5223 leader_election.cc:302] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.235751 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.235960 5404 raft_consensus.cc:2454] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.236200 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.236240 5461 raft_consensus.cc:2781] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.236390 5461 raft_consensus.cc:482] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.236528 5461 raft_consensus.cc:3037] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.236662 5223 leader_election.cc:302] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.236929 5476 raft_consensus.cc:2781] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.237018 5476 raft_consensus.cc:482] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.237092 5476 raft_consensus.cc:3037] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.236394 5332 raft_consensus.cc:2454] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.238016 5452 raft_consensus.cc:482] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.238154 5452 raft_consensus.cc:504] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.238597 5452 leader_election.cc:288] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.238945 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.238993 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.239161 5332 raft_consensus.cc:2454] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.239164 5258 raft_consensus.cc:2454] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.239496 5373 leader_election.cc:302] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.239730 5452 raft_consensus.cc:2781] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.239811 5452 raft_consensus.cc:482] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.239886 5452 raft_consensus.cc:3037] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.256510 5448 tablet_bootstrap.cc:654] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.257969 5449 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.258149 5449 ts_tablet_manager.cc:1367] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.006s
I20240501 14:02:24.258816 5452 raft_consensus.cc:504] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.258890 5476 raft_consensus.cc:504] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.258996 5449 raft_consensus.cc:348] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.259162 5449 raft_consensus.cc:374] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.259256 5449 raft_consensus.cc:729] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.259577 5456 tablet_bootstrap.cc:654] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.259514 5449 consensus_queue.cc:260] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.260083 5449 ts_tablet_manager.cc:1398] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 14:02:24.260502 5476 leader_election.cc:288] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.261054 5452 leader_election.cc:288] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.261269 5461 raft_consensus.cc:504] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.261441 5449 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.261891 5448 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.262117 5448 ts_tablet_manager.cc:1367] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20240501 14:02:24.262938 5449 tablet_bootstrap.cc:654] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.262876 5448 raft_consensus.cc:348] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.263221 5448 raft_consensus.cc:374] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.263370 5448 raft_consensus.cc:729] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.263702 5448 consensus_queue.cc:260] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.264056 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.264273 5404 raft_consensus.cc:3037] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.264410 5550 raft_consensus.cc:482] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.264581 5550 raft_consensus.cc:504] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.265177 5448 ts_tablet_manager.cc:1398] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:24.265264 5550 leader_election.cc:288] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.265590 5448 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.266119 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.266353 5406 raft_consensus.cc:2454] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.266839 5404 raft_consensus.cc:2454] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.266887 5298 leader_election.cc:302] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.267243 5223 leader_election.cc:302] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.267551 5476 raft_consensus.cc:2781] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.267707 5476 raft_consensus.cc:686] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.268008 5476 consensus_queue.cc:237] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.268095 5511 raft_consensus.cc:504] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.268504 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.268730 5333 raft_consensus.cc:3037] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.268980 5511 leader_election.cc:288] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.269912 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "911e80bff52f48abaea33317a9244f38" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.270200 5404 raft_consensus.cc:3037] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.271708 5333 raft_consensus.cc:2454] T 115b22143b004defbaae11ec0b62310f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.272439 5461 leader_election.cc:288] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.272716 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "115b22143b004defbaae11ec0b62310f" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.272778 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26da6c9b322432f934b1de3669f0646" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.272984 5257 raft_consensus.cc:3037] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.273329 5404 raft_consensus.cc:2454] T 911e80bff52f48abaea33317a9244f38 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.273458 5550 raft_consensus.cc:2781] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.273571 5550 raft_consensus.cc:482] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.273687 5550 raft_consensus.cc:3037] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.273794 5223 leader_election.cc:302] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.274101 5461 raft_consensus.cc:2781] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.274264 5461 raft_consensus.cc:686] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.274542 5461 consensus_queue.cc:237] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.267307 5448 tablet_bootstrap.cc:654] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.275743 5257 raft_consensus.cc:2454] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.272994 5259 raft_consensus.cc:3037] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.278182 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "911e80bff52f48abaea33317a9244f38" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.278409 5334 raft_consensus.cc:3037] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.278955 5259 raft_consensus.cc:2454] T 115b22143b004defbaae11ec0b62310f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.281381 5334 raft_consensus.cc:2454] T 911e80bff52f48abaea33317a9244f38 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.282009 5511 raft_consensus.cc:482] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.282052 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.282187 5511 raft_consensus.cc:504] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
W20240501 14:02:24.282706 5299 leader_election.cc:341] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.282960 5511 leader_election.cc:288] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.284289 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca91b0a4dc4a4221ab6f7e6167ade06f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.284514 5332 raft_consensus.cc:3037] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.285912 5525 raft_consensus.cc:482] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.286108 5525 raft_consensus.cc:504] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.286767 5525 leader_election.cc:288] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.287479 5332 raft_consensus.cc:2454] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.287659 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.287926 5258 raft_consensus.cc:2379] T d241cf94420f448abdc7f154be06c02f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:24.288213 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d241cf94420f448abdc7f154be06c02f" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.288996 5298 leader_election.cc:302] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.289441 5525 raft_consensus.cc:3037] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.290079 5154 catalog_manager.cc:5484] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.291486 5448 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.291692 5448 ts_tablet_manager.cc:1367] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.003s
I20240501 14:02:24.292023 5525 raft_consensus.cc:2726] T d241cf94420f448abdc7f154be06c02f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.292502 5448 raft_consensus.cc:348] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.293295 5448 raft_consensus.cc:374] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.293459 5448 raft_consensus.cc:729] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.293730 5448 consensus_queue.cc:260] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.294631 5448 ts_tablet_manager.cc:1398] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:24.294988 5448 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.295926 5156 catalog_manager.cc:5484] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.296666 5448 tablet_bootstrap.cc:654] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.297132 5461 consensus_queue.cc:1035] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.293098 5373 leader_election.cc:302] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.299104 5373 leader_election.cc:302] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.299379 5452 raft_consensus.cc:2781] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.299552 5452 raft_consensus.cc:686] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.299841 5452 consensus_queue.cc:237] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.301039 5485 raft_consensus.cc:2781] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.301205 5485 raft_consensus.cc:686] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.301501 5485 consensus_queue.cc:237] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.304904 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4de3ce01609d498fbc1318e1717297b6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.305194 5258 raft_consensus.cc:2454] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.306387 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26da6c9b322432f934b1de3669f0646" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.306633 5333 raft_consensus.cc:3037] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.306418 5476 consensus_queue.cc:1035] T 3f3db9eff53e4ec29ab17081d32097a8 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.309574 5333 raft_consensus.cc:2454] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.310034 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4de3ce01609d498fbc1318e1717297b6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.310269 5334 raft_consensus.cc:2454] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.313454 5550 raft_consensus.cc:504] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.314628 5373 leader_election.cc:302] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.315150 5455 raft_consensus.cc:2781] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.315264 5455 raft_consensus.cc:482] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.315397 5455 raft_consensus.cc:3037] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.316062 5452 consensus_queue.cc:1035] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.316329 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.316552 5452 consensus_queue.cc:1035] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 14:02:24.316910 5299 leader_election.cc:341] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.317975 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.318197 5406 raft_consensus.cc:3037] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.318045 5455 raft_consensus.cc:504] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.318921 5455 leader_election.cc:288] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.319061 5156 catalog_manager.cc:5484] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.319612 5550 leader_election.cc:288] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.319643 5156 catalog_manager.cc:5484] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.320132 5550 raft_consensus.cc:482] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.320501 5448 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.320695 5448 ts_tablet_manager.cc:1367] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.007s
I20240501 14:02:24.320503 5550 raft_consensus.cc:504] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.321107 5456 tablet_bootstrap.cc:492] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.321200 5406 raft_consensus.cc:2454] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.321292 5456 ts_tablet_manager.cc:1367] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.000s
I20240501 14:02:24.321465 5448 raft_consensus.cc:348] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.321695 5448 raft_consensus.cc:374] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.321730 5298 leader_election.cc:302] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.322022 5456 raft_consensus.cc:348] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.322196 5525 raft_consensus.cc:2781] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.322242 5456 raft_consensus.cc:374] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.322322 5456 raft_consensus.cc:729] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.322350 5525 raft_consensus.cc:686] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.322587 5456 consensus_queue.cc:260] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.322638 5525 consensus_queue.cc:237] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.322882 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.323163 5456 ts_tablet_manager.cc:1398] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20240501 14:02:24.323426 5299 leader_election.cc:341] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.323522 5456 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.324276 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.324508 5403 raft_consensus.cc:2454] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.324841 5485 consensus_queue.cc:1035] T 64a7a301cdf6415ea7e3654551f2ed91 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.325342 5298 leader_election.cc:302] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.325657 5521 raft_consensus.cc:2781] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.325769 5521 raft_consensus.cc:482] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.325855 5521 raft_consensus.cc:3037] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.321786 5448 raft_consensus.cc:729] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.328708 5448 consensus_queue.cc:260] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.328991 5521 raft_consensus.cc:504] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.329722 5521 leader_election.cc:288] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.329900 5448 ts_tablet_manager.cc:1398] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240501 14:02:24.330906 5448 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.330902 5456 tablet_bootstrap.cc:654] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.332392 5448 tablet_bootstrap.cc:654] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.332646 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.333611 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.342272 5406 raft_consensus.cc:3037] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.345821 5456 tablet_bootstrap.cc:492] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
W20240501 14:02:24.339515 5299 leader_election.cc:341] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.346058 5456 ts_tablet_manager.cc:1367] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20240501 14:02:24.341754 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4de3ce01609d498fbc1318e1717297b6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.346877 5258 raft_consensus.cc:3037] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.346963 5456 raft_consensus.cc:348] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.347218 5456 raft_consensus.cc:374] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.347326 5456 raft_consensus.cc:729] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.347601 5456 consensus_queue.cc:260] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.348353 5456 ts_tablet_manager.cc:1398] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:24.348723 5456 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.350461 5456 tablet_bootstrap.cc:654] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.352275 5449 tablet_bootstrap.cc:492] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.352486 5449 ts_tablet_manager.cc:1367] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.091s user 0.020s sys 0.052s
I20240501 14:02:24.353006 5456 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.353180 5456 ts_tablet_manager.cc:1367] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20240501 14:02:24.353278 5449 raft_consensus.cc:348] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.353533 5449 raft_consensus.cc:374] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.353623 5449 raft_consensus.cc:729] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.353878 5449 consensus_queue.cc:260] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.353987 5456 raft_consensus.cc:348] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.354167 5456 raft_consensus.cc:374] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.354251 5456 raft_consensus.cc:729] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.354449 5449 ts_tablet_manager.cc:1398] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:24.354498 5456 consensus_queue.cc:260] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.354769 5449 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.354998 5456 ts_tablet_manager.cc:1398] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:24.355298 5456 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.356233 5449 tablet_bootstrap.cc:654] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.356572 5456 tablet_bootstrap.cc:654] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.358952 5550 leader_election.cc:288] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.360162 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4de3ce01609d498fbc1318e1717297b6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.360517 5333 raft_consensus.cc:3037] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.365553 5476 consensus_queue.cc:1035] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.345851 5406 raft_consensus.cc:2454] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.368956 5298 leader_election.cc:302] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.369804 5550 raft_consensus.cc:2781] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.370112 5550 raft_consensus.cc:686] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.370609 5550 consensus_queue.cc:237] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.350432 5258 raft_consensus.cc:2454] T 4de3ce01609d498fbc1318e1717297b6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.374608 5476 consensus_queue.cc:1035] T b471619f7e3a41f280b47e269eb9afd4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.375105 5521 consensus_queue.cc:1035] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.382054 5373 leader_election.cc:302] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.382485 5485 raft_consensus.cc:2781] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.382647 5485 raft_consensus.cc:686] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.382992 5485 consensus_queue.cc:237] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.384341 5476 raft_consensus.cc:482] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.384523 5476 raft_consensus.cc:504] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.385202 5476 leader_election.cc:288] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.385272 5455 raft_consensus.cc:482] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.385486 5455 raft_consensus.cc:504] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.385939 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.386118 5455 leader_election.cc:288] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.386236 5403 raft_consensus.cc:2379] T 00df0bdc59ae4d238be73ada8da1e8b5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:24.386803 5331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:24.387365 5373 leader_election.cc:341] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.387627 5331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00df0bdc59ae4d238be73ada8da1e8b5" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.387667 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.388155 5224 leader_election.cc:302] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
W20240501 14:02:24.388723 5373 leader_election.cc:341] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.388885 5373 leader_election.cc:302] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.389289 5455 raft_consensus.cc:2726] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.389499 5476 raft_consensus.cc:3037] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.392336 5455 raft_consensus.cc:482] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.392546 5455 raft_consensus.cc:504] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.393237 5455 leader_election.cc:288] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.394002 5331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.394235 5331 raft_consensus.cc:2454] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.394696 5373 leader_election.cc:302] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.395015 5455 raft_consensus.cc:2781] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.395128 5455 raft_consensus.cc:482] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.395241 5455 raft_consensus.cc:3037] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.363551 5333 raft_consensus.cc:2454] T 4de3ce01609d498fbc1318e1717297b6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.398990 5476 raft_consensus.cc:2726] T 00df0bdc59ae4d238be73ada8da1e8b5 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.398494 5455 raft_consensus.cc:504] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.399741 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:24.400319 5373 leader_election.cc:341] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.400992 5455 leader_election.cc:288] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.401044 5331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.401243 5331 raft_consensus.cc:3037] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.401284 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
W20240501 14:02:24.402449 5373 leader_election.cc:341] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.404578 5331 raft_consensus.cc:2454] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.406087 5373 leader_election.cc:302] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.406368 5455 raft_consensus.cc:2781] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.406620 5455 raft_consensus.cc:686] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.406932 5455 consensus_queue.cc:237] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.409982 5511 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.419677 5455 consensus_queue.cc:1035] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.422820 5476 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.425292 5511 raft_consensus.cc:482] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.425495 5511 raft_consensus.cc:504] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.426208 5511 leader_election.cc:288] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.427104 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.427369 5255 raft_consensus.cc:2454] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.427779 5511 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.428155 5373 leader_election.cc:302] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.428637 5455 raft_consensus.cc:2781] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.428928 5455 raft_consensus.cc:482] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.429028 5455 raft_consensus.cc:3037] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.432730 5455 raft_consensus.cc:504] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.433928 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.434165 5256 raft_consensus.cc:3037] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.434405 5511 raft_consensus.cc:482] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.434584 5511 raft_consensus.cc:504] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.435254 5511 leader_election.cc:288] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.435812 5511 raft_consensus.cc:482] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.435969 5511 raft_consensus.cc:504] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.436599 5511 leader_election.cc:288] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.437359 5256 raft_consensus.cc:2454] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.437894 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5589c888edde48688e0a953adc192957" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.438179 5330 raft_consensus.cc:2454] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.439060 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.439693 5373 leader_election.cc:302] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
W20240501 14:02:24.440050 5373 leader_election.cc:341] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.441100 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.442124 5373 leader_election.cc:302] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
W20240501 14:02:24.442577 5373 leader_election.cc:341] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.442787 5373 leader_election.cc:302] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.441406 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5589c888edde48688e0a953adc192957" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.443759 5256 raft_consensus.cc:2454] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.441606 5511 raft_consensus.cc:2781] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.444089 5511 raft_consensus.cc:482] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.444275 5511 raft_consensus.cc:3037] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.445385 5455 leader_election.cc:288] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.445600 5455 raft_consensus.cc:2781] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.445731 5455 raft_consensus.cc:686] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.446045 5455 consensus_queue.cc:237] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.447446 5511 raft_consensus.cc:504] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.448252 5511 leader_election.cc:288] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.448623 5511 raft_consensus.cc:2726] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.448925 5331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.472623 5543 raft_consensus.cc:482] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.472816 5543 raft_consensus.cc:504] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.452225 5521 consensus_queue.cc:1035] T 6a2428cca58742fabb9a656f90ce5b47 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.473608 5543 leader_election.cc:288] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.454903 5154 catalog_manager.cc:5484] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.457718 5156 catalog_manager.cc:5484] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.474740 5448 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.460887 5552 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.474943 5448 ts_tablet_manager.cc:1367] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.144s user 0.017s sys 0.018s
I20240501 14:02:24.464582 5477 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.469040 5485 consensus_queue.cc:1035] T d241cf94420f448abdc7f154be06c02f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.475972 5448 raft_consensus.cc:348] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.476310 5448 raft_consensus.cc:374] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.474946 5156 catalog_manager.cc:5484] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.476547 5448 raft_consensus.cc:729] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.476832 5448 consensus_queue.cc:260] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.469625 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.469902 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5589c888edde48688e0a953adc192957" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.470117 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5589c888edde48688e0a953adc192957" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.478173 5333 raft_consensus.cc:3037] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.483575 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.488580 5257 raft_consensus.cc:3037] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.490244 5333 raft_consensus.cc:2454] T 5589c888edde48688e0a953adc192957 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.492228 5448 ts_tablet_manager.cc:1398] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.492941 5156 catalog_manager.cc:5484] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.495177 5257 raft_consensus.cc:2454] T 5589c888edde48688e0a953adc192957 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.495502 5448 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
W20240501 14:02:24.511560 5206 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20240501 14:02:24.512343 5373 leader_election.cc:341] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.512691 5334 raft_consensus.cc:2454] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.512833 5456 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.514061 5456 ts_tablet_manager.cc:1367] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.159s user 0.034s sys 0.054s
I20240501 14:02:24.512913 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.514933 5456 raft_consensus.cc:348] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.515177 5404 raft_consensus.cc:2454] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.515259 5456 raft_consensus.cc:374] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.513114 5448 tablet_bootstrap.cc:654] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.513196 5452 raft_consensus.cc:482] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.515357 5456 raft_consensus.cc:729] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.515478 5452 raft_consensus.cc:504] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.515579 5456 consensus_queue.cc:260] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.516202 5452 leader_election.cc:288] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.513303 5154 catalog_manager.cc:5484] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.516556 5224 leader_election.cc:302] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.516880 5476 raft_consensus.cc:2781] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.516971 5476 raft_consensus.cc:482] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.517071 5476 raft_consensus.cc:3037] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.520229 5476 raft_consensus.cc:504] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.521036 5476 leader_election.cc:288] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.522011 5404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.522234 5404 raft_consensus.cc:3037] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
W20240501 14:02:24.522414 5373 leader_election.cc:341] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.522819 5373 leader_election.cc:302] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.523566 5608 raft_consensus.cc:2781] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.523720 5608 raft_consensus.cc:686] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.525121 5404 raft_consensus.cc:2454] T 5cd3884f93c1499783fe394bff59ff04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.525228 5608 consensus_queue.cc:237] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.525923 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd3884f93c1499783fe394bff59ff04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.526154 5334 raft_consensus.cc:3037] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.513675 5449 tablet_bootstrap.cc:492] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.527503 5449 ts_tablet_manager.cc:1367] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.173s user 0.012s sys 0.042s
I20240501 14:02:24.528302 5605 consensus_queue.cc:1035] T 40017157bdb9475585d127bf93668562 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.528885 5449 raft_consensus.cc:348] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.529213 5449 raft_consensus.cc:374] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.529376 5449 raft_consensus.cc:729] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.529315 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b72895e50094c2fbcf0383a791594f7" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.529731 5257 raft_consensus.cc:2454] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.529755 5449 consensus_queue.cc:260] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.530483 5449 ts_tablet_manager.cc:1398] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:24.530849 5449 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.532898 5449 tablet_bootstrap.cc:654] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.533445 5448 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.533643 5448 ts_tablet_manager.cc:1367] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.004s
I20240501 14:02:24.535346 5605 raft_consensus.cc:482] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.535530 5605 raft_consensus.cc:504] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.535591 5448 raft_consensus.cc:348] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.535790 5448 raft_consensus.cc:374] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.535879 5448 raft_consensus.cc:729] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.536114 5448 consensus_queue.cc:260] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.536346 5605 leader_election.cc:288] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.536672 5223 leader_election.cc:302] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.537168 5552 raft_consensus.cc:2781] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.537348 5552 raft_consensus.cc:686] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.537636 5552 consensus_queue.cc:237] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.539265 5403 raft_consensus.cc:3037] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.514923 5543 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.542457 5456 ts_tablet_manager.cc:1398] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.542795 5456 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.542872 5543 consensus_queue.cc:1035] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.544325 5456 tablet_bootstrap.cc:654] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.546113 5334 raft_consensus.cc:2454] T 5cd3884f93c1499783fe394bff59ff04 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.551640 5543 consensus_queue.cc:1035] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.528349 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b72895e50094c2fbcf0383a791594f7" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.553669 5449 tablet_bootstrap.cc:492] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.553845 5449 ts_tablet_manager.cc:1367] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.007s
I20240501 14:02:24.554649 5449 raft_consensus.cc:348] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.554893 5449 raft_consensus.cc:374] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.554941 5449 raft_consensus.cc:729] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.555140 5449 consensus_queue.cc:260] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.555735 5449 ts_tablet_manager.cc:1398] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:24.556553 5449 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.556500 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.558091 5449 tablet_bootstrap.cc:654] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
W20240501 14:02:24.559165 5373 leader_election.cc:341] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:24.559360 5373 leader_election.cc:341] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.559506 5373 leader_election.cc:302] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.559751 5452 raft_consensus.cc:2781] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.559820 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.559829 5452 raft_consensus.cc:482] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.560256 5452 raft_consensus.cc:3037] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.563135 5452 raft_consensus.cc:504] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.563920 5452 leader_election.cc:288] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
W20240501 14:02:24.564782 5373 leader_election.cc:341] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.564806 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b72895e50094c2fbcf0383a791594f7" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.564924 5373 leader_election.cc:302] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.565039 5332 raft_consensus.cc:3037] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.565083 5448 ts_tablet_manager.cc:1398] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:02:24.565299 5452 raft_consensus.cc:2726] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.565402 5448 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.565819 5476 consensus_queue.cc:1035] T bfffbd2bdae64276afa3b5b5ca7fd5d4 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.566823 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b72895e50094c2fbcf0383a791594f7" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.566987 5257 raft_consensus.cc:3037] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.568017 5332 raft_consensus.cc:2454] T 3b72895e50094c2fbcf0383a791594f7 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.569912 5373 leader_election.cc:302] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.569998 5257 raft_consensus.cc:2454] T 3b72895e50094c2fbcf0383a791594f7 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.570323 5452 raft_consensus.cc:2781] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.570452 5452 raft_consensus.cc:686] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.570722 5452 consensus_queue.cc:237] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.573350 5156 catalog_manager.cc:5484] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.566977 5448 tablet_bootstrap.cc:654] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.582419 5449 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.582635 5449 ts_tablet_manager.cc:1367] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.015s
I20240501 14:02:24.583464 5449 raft_consensus.cc:348] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.583781 5449 raft_consensus.cc:374] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.583882 5449 raft_consensus.cc:729] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.584224 5449 consensus_queue.cc:260] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.585090 5449 ts_tablet_manager.cc:1398] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:24.585438 5449 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.586977 5449 tablet_bootstrap.cc:654] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.589334 5456 tablet_bootstrap.cc:492] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.589485 5456 ts_tablet_manager.cc:1367] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.006s
I20240501 14:02:24.590013 5470 consensus_queue.cc:1035] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.590296 5456 raft_consensus.cc:348] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.590498 5456 raft_consensus.cc:374] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.590553 5456 raft_consensus.cc:729] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.591367 5448 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.591514 5448 ts_tablet_manager.cc:1367] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.001s
I20240501 14:02:24.591935 5156 catalog_manager.cc:5484] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:24.592360 5448 raft_consensus.cc:348] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.592550 5448 raft_consensus.cc:374] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.592605 5448 raft_consensus.cc:729] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.592821 5448 consensus_queue.cc:260] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.593474 5448 ts_tablet_manager.cc:1398] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:24.593778 5448 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.596560 5449 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.596792 5449 ts_tablet_manager.cc:1367] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20240501 14:02:24.597334 5456 consensus_queue.cc:260] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.597661 5449 raft_consensus.cc:348] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.597873 5449 raft_consensus.cc:374] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.597976 5449 raft_consensus.cc:729] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.598084 5456 ts_tablet_manager.cc:1398] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 14:02:24.598347 5456 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.598299 5449 consensus_queue.cc:260] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.598206 5157 catalog_manager.cc:5484] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:24.599117 5448 tablet_bootstrap.cc:654] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.598891 5449 ts_tablet_manager.cc:1398] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.602725 5550 consensus_queue.cc:1035] T dbcc64e86378485cb6231e2ec17a533b P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.602962 5449 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.603567 5552 consensus_queue.cc:1035] T bc4fdc2cf86a44348638047a20860698 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.604542 5449 tablet_bootstrap.cc:654] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.605942 5448 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.606308 5448 ts_tablet_manager.cc:1367] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20240501 14:02:24.607038 5448 raft_consensus.cc:348] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.607347 5448 raft_consensus.cc:374] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.607470 5448 raft_consensus.cc:729] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.606175 5456 tablet_bootstrap.cc:654] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.608832 5448 consensus_queue.cc:260] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.609575 5448 ts_tablet_manager.cc:1398] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:02:24.610528 5448 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.612363 5448 tablet_bootstrap.cc:654] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.616434 5552 raft_consensus.cc:482] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.616640 5552 raft_consensus.cc:504] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.617955 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.618247 5403 raft_consensus.cc:2379] T 2c63139d6ab242c2bb31e84df50aaee5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:24.619156 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c63139d6ab242c2bb31e84df50aaee5" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.619828 5224 leader_election.cc:302] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.620131 5477 raft_consensus.cc:3037] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.623366 5477 raft_consensus.cc:2726] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.623839 5552 leader_election.cc:288] T 2c63139d6ab242c2bb31e84df50aaee5 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.629137 5448 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.629341 5448 ts_tablet_manager.cc:1367] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.007s
I20240501 14:02:24.629137 5449 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.630038 5449 ts_tablet_manager.cc:1367] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.010s
I20240501 14:02:24.630833 5448 raft_consensus.cc:348] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.631062 5448 raft_consensus.cc:374] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.631130 5448 raft_consensus.cc:729] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.631459 5449 raft_consensus.cc:348] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.631664 5449 raft_consensus.cc:374] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.631731 5449 raft_consensus.cc:729] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.631681 5448 consensus_queue.cc:260] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.632030 5449 consensus_queue.cc:260] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.632272 5448 ts_tablet_manager.cc:1398] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:02:24.632558 5448 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.632649 5449 ts_tablet_manager.cc:1398] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.632898 5449 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.634414 5449 tablet_bootstrap.cc:654] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.634768 5448 tablet_bootstrap.cc:654] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.634938 5550 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.637976 5456 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.638183 5456 ts_tablet_manager.cc:1367] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.010s
I20240501 14:02:24.638937 5456 raft_consensus.cc:348] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.639219 5456 raft_consensus.cc:374] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.639323 5456 raft_consensus.cc:729] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.639639 5456 consensus_queue.cc:260] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.640342 5456 ts_tablet_manager.cc:1398] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.640662 5456 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.642385 5456 tablet_bootstrap.cc:654] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.651046 5456 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.651368 5456 ts_tablet_manager.cc:1367] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240501 14:02:24.653023 5552 consensus_queue.cc:1035] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.655524 5470 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.664938 5456 raft_consensus.cc:348] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.665218 5456 raft_consensus.cc:374] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.665285 5456 raft_consensus.cc:729] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.665599 5449 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.665547 5456 consensus_queue.cc:260] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.665747 5449 ts_tablet_manager.cc:1367] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.024s
I20240501 14:02:24.666095 5456 ts_tablet_manager.cc:1398] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:24.666407 5456 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.666136 5448 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.667048 5448 ts_tablet_manager.cc:1367] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.007s
I20240501 14:02:24.666416 5449 raft_consensus.cc:348] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.667376 5449 raft_consensus.cc:374] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.667428 5449 raft_consensus.cc:729] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.667713 5448 raft_consensus.cc:348] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.667908 5448 raft_consensus.cc:374] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.667958 5448 raft_consensus.cc:729] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.669296 5456 tablet_bootstrap.cc:654] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.668149 5448 consensus_queue.cc:260] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.670331 5448 ts_tablet_manager.cc:1398] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:24.667631 5449 consensus_queue.cc:260] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.670732 5449 ts_tablet_manager.cc:1398] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 14:02:24.671011 5449 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.672467 5448 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.674259 5448 tablet_bootstrap.cc:654] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.675753 5449 tablet_bootstrap.cc:654] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.675961 5456 tablet_bootstrap.cc:492] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.676128 5456 ts_tablet_manager.cc:1367] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240501 14:02:24.676889 5456 raft_consensus.cc:348] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.677111 5456 raft_consensus.cc:374] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.677189 5456 raft_consensus.cc:729] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.677388 5456 consensus_queue.cc:260] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.677980 5456 ts_tablet_manager.cc:1398] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.678299 5456 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.679476 5543 consensus_queue.cc:1035] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.679888 5456 tablet_bootstrap.cc:654] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.685024 5452 raft_consensus.cc:482] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.685223 5452 raft_consensus.cc:504] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.685902 5452 leader_election.cc:288] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.686287 5476 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.686475 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.686534 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:24.687052 5373 leader_election.cc:341] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:24.687274 5373 leader_election.cc:341] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.687382 5373 leader_election.cc:302] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.687798 5452 raft_consensus.cc:2726] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.691193 5452 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.693979 5543 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.700629 5452 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.707459 5448 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:24.707633 5448 ts_tablet_manager.cc:1367] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.035s user 0.018s sys 0.012s
I20240501 14:02:24.709074 5448 raft_consensus.cc:348] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.709285 5448 raft_consensus.cc:374] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.709342 5448 raft_consensus.cc:729] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.709647 5449 tablet_bootstrap.cc:492] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:24.709599 5448 consensus_queue.cc:260] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.709784 5449 ts_tablet_manager.cc:1367] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.002s
I20240501 14:02:24.710165 5448 ts_tablet_manager.cc:1398] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:24.710443 5448 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:24.710567 5449 raft_consensus.cc:348] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.710729 5449 raft_consensus.cc:374] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.710779 5449 raft_consensus.cc:729] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.710973 5449 consensus_queue.cc:260] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.711781 5449 ts_tablet_manager.cc:1398] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.712059 5449 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:24.712194 5448 tablet_bootstrap.cc:654] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.713809 5449 tablet_bootstrap.cc:654] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.718684 5525 consensus_queue.cc:1035] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.720769 5525 consensus_queue.cc:1035] T 18d6cd1be8584b9281251bbf29f19c39 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.722756 5456 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.723004 5456 ts_tablet_manager.cc:1367] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.008s
I20240501 14:02:24.723966 5456 raft_consensus.cc:348] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.724346 5456 raft_consensus.cc:374] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.724457 5456 raft_consensus.cc:729] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.724854 5456 consensus_queue.cc:260] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.725574 5456 ts_tablet_manager.cc:1398] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:24.725983 5456 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.727886 5456 tablet_bootstrap.cc:654] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.736996 5456 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:24.737190 5456 ts_tablet_manager.cc:1367] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20240501 14:02:24.738083 5456 raft_consensus.cc:348] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.738299 5456 raft_consensus.cc:374] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:24.738363 5456 raft_consensus.cc:729] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:24.738582 5456 consensus_queue.cc:260] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.739197 5456 ts_tablet_manager.cc:1398] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:24.739490 5456 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:24.741386 5456 tablet_bootstrap.cc:654] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:24.742026 5552 raft_consensus.cc:482] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.742182 5552 raft_consensus.cc:504] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.742928 5552 leader_election.cc:288] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.743547 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf222bcb0e12403da462db45e174042f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.743731 5403 raft_consensus.cc:2454] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.744414 5223 leader_election.cc:302] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.744697 5476 raft_consensus.cc:2781] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.744764 5476 raft_consensus.cc:482] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.744822 5476 raft_consensus.cc:3037] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.749370 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf222bcb0e12403da462db45e174042f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.749938 5525 consensus_queue.cc:1035] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 14:02:24.750061 5224 leader_election.cc:341] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.750582 5608 raft_consensus.cc:482] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.750716 5608 raft_consensus.cc:504] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.751421 5608 leader_election.cc:288] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.752210 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5f7f90f4440d792cbd722f41aa240" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.752408 5334 raft_consensus.cc:2454] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.754220 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5f7f90f4440d792cbd722f41aa240" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.754406 5256 raft_consensus.cc:2454] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.754889 5373 leader_election.cc:302] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.755504 5608 raft_consensus.cc:2781] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.755590 5608 raft_consensus.cc:482] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.755648 5608 raft_consensus.cc:3037] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.759186 5608 raft_consensus.cc:504] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.760792 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5f7f90f4440d792cbd722f41aa240" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.761070 5256 raft_consensus.cc:3037] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.765144 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5f7f90f4440d792cbd722f41aa240" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.765395 5334 raft_consensus.cc:3037] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.766860 5552 raft_consensus.cc:482] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.767006 5552 raft_consensus.cc:504] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.767726 5552 leader_election.cc:288] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.769613 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.771677 5334 raft_consensus.cc:2454] T 9ff5f7f90f4440d792cbd722f41aa240 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.772496 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44623c1852484ccb95d3aa2238745ec9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.772670 5373 leader_election.cc:302] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:24.772747 5332 raft_consensus.cc:2379] T 44623c1852484ccb95d3aa2238745ec9 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:24.772933 5605 raft_consensus.cc:2781] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.773037 5605 raft_consensus.cc:686] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.773207 5224 leader_election.cc:302] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.773293 5605 consensus_queue.cc:237] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.774940 5552 raft_consensus.cc:3037] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.778337 5552 raft_consensus.cc:2726] T 44623c1852484ccb95d3aa2238745ec9 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.779951 5452 consensus_queue.cc:1035] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.785976 5476 raft_consensus.cc:504] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.787775 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf222bcb0e12403da462db45e174042f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:24.788520 5224 leader_election.cc:341] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.789465 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf222bcb0e12403da462db45e174042f" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.789662 5403 raft_consensus.cc:3037] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.791811 5525 consensus_queue.cc:1035] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.792382 5476 leader_election.cc:288] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.793915 5403 raft_consensus.cc:2454] T cf222bcb0e12403da462db45e174042f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.794988 5223 leader_election.cc:302] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.795531 5543 raft_consensus.cc:2781] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.795648 5543 raft_consensus.cc:686] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.795945 5543 consensus_queue.cc:237] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.801757 5543 consensus_queue.cc:1035] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.803807 5256 raft_consensus.cc:2454] T 9ff5f7f90f4440d792cbd722f41aa240 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.805521 5485 consensus_queue.cc:1035] T 115b22143b004defbaae11ec0b62310f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.812952 5552 consensus_queue.cc:1035] T 911e80bff52f48abaea33317a9244f38 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.828310 5525 raft_consensus.cc:482] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.828500 5525 raft_consensus.cc:504] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.829296 5525 leader_election.cc:288] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.830359 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.830719 5256 raft_consensus.cc:2379] T 01a94ff5f43b460e966699c0e9c5730a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:24.832648 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a94ff5f43b460e966699c0e9c5730a" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.833326 5298 leader_election.cc:302] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.833868 5525 raft_consensus.cc:3037] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.837081 5525 raft_consensus.cc:2726] T 01a94ff5f43b460e966699c0e9c5730a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:24.840093 5452 consensus_queue.cc:1035] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.841285 5608 leader_election.cc:288] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.850746 5608 consensus_queue.cc:1035] T 4de3ce01609d498fbc1318e1717297b6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.859692 5525 raft_consensus.cc:482] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.859875 5525 raft_consensus.cc:504] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.860599 5525 leader_election.cc:288] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.861261 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:24.861819 5299 leader_election.cc:341] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.862130 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.862365 5403 raft_consensus.cc:2454] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:24.862855 5298 leader_election.cc:302] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.863399 5525 raft_consensus.cc:2781] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.863517 5525 raft_consensus.cc:482] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.863675 5525 raft_consensus.cc:3037] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.869969 5521 consensus_queue.cc:1035] T 2c63139d6ab242c2bb31e84df50aaee5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.866969 5525 raft_consensus.cc:504] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.890689 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
W20240501 14:02:24.891302 5299 leader_election.cc:341] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.897248 5525 leader_election.cc:288] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.897608 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.897876 5403 raft_consensus.cc:3037] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.901379 5403 raft_consensus.cc:2454] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:24.902006 5298 leader_election.cc:302] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:24.903764 5608 consensus_queue.cc:1035] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.910223 5608 consensus_queue.cc:1035] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.911383 5521 raft_consensus.cc:2781] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.911513 5521 raft_consensus.cc:686] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:24.911764 5521 consensus_queue.cc:237] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.925165 5552 raft_consensus.cc:482] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.925534 5552 raft_consensus.cc:504] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.926891 5552 leader_election.cc:288] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.927553 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.927799 5330 raft_consensus.cc:2454] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.928310 5224 leader_election.cc:302] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.928593 5552 raft_consensus.cc:2781] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.928668 5552 raft_consensus.cc:482] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.928725 5552 raft_consensus.cc:3037] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.929461 5470 consensus_queue.cc:1035] T 00df0bdc59ae4d238be73ada8da1e8b5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.934935 5552 raft_consensus.cc:504] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.937744 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:24.938001 5330 raft_consensus.cc:3037] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.941378 5330 raft_consensus.cc:2454] T 57e68e51675e4d6a8167536678298504 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.943368 5224 leader_election.cc:302] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.943862 5608 consensus_queue.cc:1035] T 44623c1852484ccb95d3aa2238745ec9 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:24.944566 5476 raft_consensus.cc:2781] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.944720 5476 raft_consensus.cc:686] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:24.945068 5476 consensus_queue.cc:237] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.957468 5403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:24.957891 5403 raft_consensus.cc:2454] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:24.958161 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57e68e51675e4d6a8167536678298504" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:24.958371 5408 raft_consensus.cc:3037] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.961890 5408 raft_consensus.cc:2454] T 57e68e51675e4d6a8167536678298504 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:24.966238 5552 leader_election.cc:288] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:24.978991 5608 raft_consensus.cc:482] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:24.979243 5608 raft_consensus.cc:504] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.979936 5608 leader_election.cc:288] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.980948 5252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:24.981223 5252 raft_consensus.cc:2454] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:24.981643 5373 leader_election.cc:302] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:24.981941 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:24.982290 5452 raft_consensus.cc:2781] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:24.982373 5452 raft_consensus.cc:482] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:24.982443 5452 raft_consensus.cc:3037] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
W20240501 14:02:24.982578 5373 leader_election.cc:341] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.985432 5452 raft_consensus.cc:504] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:24.988924 5452 leader_election.cc:288] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:24.989522 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:24.990764 5258 raft_consensus.cc:3037] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:24.989306 5333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:24.992687 5373 leader_election.cc:341] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:24.995201 5258 raft_consensus.cc:2454] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:24.995649 5373 leader_election.cc:302] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:24.996165 5605 raft_consensus.cc:2781] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:24.996421 5605 raft_consensus.cc:686] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:24.996747 5605 consensus_queue.cc:237] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.001432 5511 consensus_queue.cc:1035] T 01a94ff5f43b460e966699c0e9c5730a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.011065 5157 catalog_manager.cc:5484] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.012925 5476 consensus_queue.cc:1035] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.017657 5608 raft_consensus.cc:482] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.017846 5608 raft_consensus.cc:504] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.018515 5608 leader_election.cc:288] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.019186 5258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:25.019738 5373 leader_election.cc:341] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.021951 5476 raft_consensus.cc:482] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.022092 5476 raft_consensus.cc:504] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.022709 5476 leader_election.cc:288] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.023437 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:25.023972 5224 leader_election.cc:341] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.023434 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:25.024585 5223 leader_election.cc:341] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.024760 5223 leader_election.cc:302] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.025066 5476 raft_consensus.cc:2726] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.026120 5157 catalog_manager.cc:5484] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.033567 5154 catalog_manager.cc:5484] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.038614 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.038877 5334 raft_consensus.cc:2454] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.040019 5373 leader_election.cc:302] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.040588 5608 raft_consensus.cc:2781] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.040691 5608 raft_consensus.cc:482] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.040753 5608 raft_consensus.cc:3037] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.043985 5608 raft_consensus.cc:504] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.046056 5257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
W20240501 14:02:25.046594 5373 leader_election.cc:341] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.047020 5608 leader_election.cc:288] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.048970 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.049254 5332 raft_consensus.cc:3037] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.054172 5476 consensus_queue.cc:1035] T 5cd3884f93c1499783fe394bff59ff04 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.069348 5456 tablet_bootstrap.cc:492] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.069641 5456 ts_tablet_manager.cc:1367] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.330s user 0.061s sys 0.114s
I20240501 14:02:25.070657 5456 raft_consensus.cc:348] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.071075 5456 raft_consensus.cc:374] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.071229 5456 raft_consensus.cc:729] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.071583 5456 consensus_queue.cc:260] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.072324 5456 ts_tablet_manager.cc:1398] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.073443 5449 tablet_bootstrap.cc:492] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.073606 5456 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.073819 5332 raft_consensus.cc:2454] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.073679 5449 ts_tablet_manager.cc:1367] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.362s user 0.061s sys 0.065s
I20240501 14:02:25.075408 5449 raft_consensus.cc:348] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.075711 5456 tablet_bootstrap.cc:654] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.075759 5449 raft_consensus.cc:374] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.075985 5449 raft_consensus.cc:729] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.076085 5521 raft_consensus.cc:482] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.076267 5521 raft_consensus.cc:504] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.076404 5449 consensus_queue.cc:260] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.076676 5154 catalog_manager.cc:5484] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.077176 5449 ts_tablet_manager.cc:1398] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:25.077551 5449 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.078001 5154 catalog_manager.cc:5484] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.078760 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.078979 5406 raft_consensus.cc:2454] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.079416 5298 leader_election.cc:302] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.079634 5449 tablet_bootstrap.cc:654] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.079718 5525 raft_consensus.cc:2781] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.079815 5525 raft_consensus.cc:482] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.079931 5525 raft_consensus.cc:3037] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.081532 5448 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.081770 5448 ts_tablet_manager.cc:1367] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.371s user 0.067s sys 0.139s
I20240501 14:02:25.082607 5448 raft_consensus.cc:348] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.082924 5448 raft_consensus.cc:374] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.083060 5448 raft_consensus.cc:729] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.083364 5448 consensus_queue.cc:260] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.083716 5521 leader_election.cc:288] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.084774 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.085016 5253 raft_consensus.cc:2454] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.082728 5525 raft_consensus.cc:504] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.086463 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.086742 5255 raft_consensus.cc:3037] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.090055 5255 raft_consensus.cc:2454] T 3a60c4f4da7f4cd29be5695a78825784 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.090513 5299 leader_election.cc:302] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.091607 5456 tablet_bootstrap.cc:492] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.091790 5456 ts_tablet_manager.cc:1367] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.003s
I20240501 14:02:25.092031 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a60c4f4da7f4cd29be5695a78825784" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.092290 5407 raft_consensus.cc:3037] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.092540 5521 raft_consensus.cc:2781] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.092832 5521 raft_consensus.cc:686] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.093123 5521 consensus_queue.cc:237] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.093598 5525 leader_election.cc:288] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.096267 5407 raft_consensus.cc:2454] T 3a60c4f4da7f4cd29be5695a78825784 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.084380 5373 leader_election.cc:302] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.097164 5605 raft_consensus.cc:2781] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.097304 5605 raft_consensus.cc:686] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:25.084035 5448 ts_tablet_manager.cc:1398] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.097528 5605 consensus_queue.cc:237] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.097767 5448 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.103050 5448 tablet_bootstrap.cc:654] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.103757 5608 raft_consensus.cc:482] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.103880 5608 raft_consensus.cc:504] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.104600 5608 leader_election.cc:288] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.105171 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:25.106052 5373 leader_election.cc:341] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.106333 5608 consensus_queue.cc:1035] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.106420 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:25.108165 5373 leader_election.cc:341] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.108314 5373 leader_election.cc:302] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.108677 5608 raft_consensus.cc:2726] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.112433 5456 raft_consensus.cc:348] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.112648 5456 raft_consensus.cc:374] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.112710 5456 raft_consensus.cc:729] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.114553 5456 consensus_queue.cc:260] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.115186 5476 raft_consensus.cc:482] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.115314 5476 raft_consensus.cc:504] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.115919 5476 leader_election.cc:288] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.116403 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.116616 5407 raft_consensus.cc:2379] T cb23750de77847ee96aa43bab357ebd1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:25.116883 5511 consensus_queue.cc:1035] T 3b72895e50094c2fbcf0383a791594f7 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.118279 5456 ts_tablet_manager.cc:1398] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20240501 14:02:25.118592 5456 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.119983 5525 raft_consensus.cc:482] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.120098 5525 raft_consensus.cc:504] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.120785 5525 leader_election.cc:288] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.119830 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb23750de77847ee96aa43bab357ebd1" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.121387 5456 tablet_bootstrap.cc:654] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.121404 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.121785 5224 leader_election.cc:302] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.122057 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a564d8cf00624da7a2cfc98cf6740d84" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.122175 5476 raft_consensus.cc:3037] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.122269 5253 raft_consensus.cc:2379] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:25.122648 5299 leader_election.cc:302] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.123023 5525 raft_consensus.cc:3037] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.123252 5449 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.123435 5449 ts_tablet_manager.cc:1367] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.046s user 0.022s sys 0.017s
I20240501 14:02:25.124224 5449 raft_consensus.cc:348] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.124478 5449 raft_consensus.cc:374] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.124580 5449 raft_consensus.cc:729] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.124810 5476 raft_consensus.cc:2726] T cb23750de77847ee96aa43bab357ebd1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.124862 5449 consensus_queue.cc:260] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.125535 5525 raft_consensus.cc:2726] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.125696 5449 ts_tablet_manager.cc:1398] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:25.126030 5449 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.127543 5449 tablet_bootstrap.cc:654] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.129526 5456 tablet_bootstrap.cc:492] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.129595 5448 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.129875 5448 ts_tablet_manager.cc:1367] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.005s
I20240501 14:02:25.129842 5155 catalog_manager.cc:5484] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.129729 5456 ts_tablet_manager.cc:1367] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20240501 14:02:25.131058 5456 raft_consensus.cc:348] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.132150 5456 raft_consensus.cc:374] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.132259 5456 raft_consensus.cc:729] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.132511 5456 consensus_queue.cc:260] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.132686 5448 raft_consensus.cc:348] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.133337 5448 raft_consensus.cc:374] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.133459 5448 raft_consensus.cc:729] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.133019 5449 tablet_bootstrap.cc:492] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.133790 5449 ts_tablet_manager.cc:1367] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20240501 14:02:25.133066 5456 ts_tablet_manager.cc:1398] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240501 14:02:25.134299 5448 consensus_queue.cc:260] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.135532 5448 ts_tablet_manager.cc:1398] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240501 14:02:25.135565 5157 catalog_manager.cc:5484] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.135932 5448 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.136312 5605 consensus_queue.cc:1035] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.134589 5456 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.134946 5449 raft_consensus.cc:348] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.136662 5449 raft_consensus.cc:374] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.136763 5449 raft_consensus.cc:729] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.137022 5449 consensus_queue.cc:260] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.137696 5449 ts_tablet_manager.cc:1398] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 14:02:25.138860 5449 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.138891 5448 tablet_bootstrap.cc:654] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.140414 5449 tablet_bootstrap.cc:654] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.142930 5605 consensus_queue.cc:1035] T 5589c888edde48688e0a953adc192957 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.138129 5456 tablet_bootstrap.cc:654] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.156458 5456 tablet_bootstrap.cc:492] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.156639 5456 ts_tablet_manager.cc:1367] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
I20240501 14:02:25.157410 5456 raft_consensus.cc:348] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.157624 5456 raft_consensus.cc:374] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.157694 5456 raft_consensus.cc:729] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.158013 5456 consensus_queue.cc:260] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.159655 5456 ts_tablet_manager.cc:1398] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:25.159960 5456 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.163496 5456 tablet_bootstrap.cc:654] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.178125 5449 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.178277 5449 ts_tablet_manager.cc:1367] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.024s
I20240501 14:02:25.178377 5456 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.178526 5456 ts_tablet_manager.cc:1367] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.007s
I20240501 14:02:25.178949 5448 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.178952 5449 raft_consensus.cc:348] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.179167 5449 raft_consensus.cc:374] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.179144 5448 ts_tablet_manager.cc:1367] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.043s user 0.022s sys 0.017s
I20240501 14:02:25.179272 5449 raft_consensus.cc:729] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.179157 5456 raft_consensus.cc:348] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.179374 5456 raft_consensus.cc:374] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.179440 5456 raft_consensus.cc:729] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.179512 5449 consensus_queue.cc:260] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.179625 5456 consensus_queue.cc:260] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.180011 5449 ts_tablet_manager.cc:1398] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.180235 5456 ts_tablet_manager.cc:1398] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.180210 5448 raft_consensus.cc:348] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.180359 5448 raft_consensus.cc:374] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.180393 5448 raft_consensus.cc:729] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.180630 5456 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.180555 5448 consensus_queue.cc:260] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.181972 5448 ts_tablet_manager.cc:1398] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:25.182245 5448 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.182461 5449 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.184010 5448 tablet_bootstrap.cc:654] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.184657 5456 tablet_bootstrap.cc:654] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.187511 5449 tablet_bootstrap.cc:654] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.189828 5456 tablet_bootstrap.cc:492] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.189971 5456 ts_tablet_manager.cc:1367] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20240501 14:02:25.190008 5448 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.190128 5448 ts_tablet_manager.cc:1367] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20240501 14:02:25.190529 5456 raft_consensus.cc:348] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.190687 5456 raft_consensus.cc:374] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.190618 5448 raft_consensus.cc:348] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.190760 5456 raft_consensus.cc:729] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.190797 5448 raft_consensus.cc:374] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.190857 5448 raft_consensus.cc:729] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.190969 5456 consensus_queue.cc:260] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.191022 5448 consensus_queue.cc:260] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.191475 5448 ts_tablet_manager.cc:1398] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 14:02:25.191735 5456 ts_tablet_manager.cc:1398] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.191984 5456 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.192481 5448 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.193888 5456 tablet_bootstrap.cc:654] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.193888 5448 tablet_bootstrap.cc:654] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.194945 5449 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.195091 5449 ts_tablet_manager.cc:1367] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20240501 14:02:25.195834 5449 raft_consensus.cc:348] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.196033 5449 raft_consensus.cc:374] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.196089 5449 raft_consensus.cc:729] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.197201 5449 consensus_queue.cc:260] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.199306 5449 ts_tablet_manager.cc:1398] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:25.199621 5449 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.199652 5476 consensus_queue.cc:1035] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.201436 5449 tablet_bootstrap.cc:654] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.203392 5448 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.203537 5448 ts_tablet_manager.cc:1367] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240501 14:02:25.203655 5449 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.203799 5449 ts_tablet_manager.cc:1367] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:02:25.204284 5448 raft_consensus.cc:348] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.204469 5448 raft_consensus.cc:374] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.204519 5448 raft_consensus.cc:729] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.204752 5448 consensus_queue.cc:260] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.205453 5448 ts_tablet_manager.cc:1398] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.205734 5448 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.206068 5449 raft_consensus.cc:348] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.206313 5449 raft_consensus.cc:374] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.206413 5449 raft_consensus.cc:729] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.206673 5449 consensus_queue.cc:260] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.207239 5449 ts_tablet_manager.cc:1398] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:25.207525 5449 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.208571 5448 tablet_bootstrap.cc:654] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.209223 5521 raft_consensus.cc:482] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.209379 5521 raft_consensus.cc:504] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.210076 5521 leader_election.cc:288] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.210784 5449 tablet_bootstrap.cc:654] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.211108 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.211300 5405 raft_consensus.cc:2454] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.210695 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.211513 5253 raft_consensus.cc:2454] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.212066 5299 leader_election.cc:302] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.212900 5525 raft_consensus.cc:2781] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.212985 5525 raft_consensus.cc:482] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.213044 5525 raft_consensus.cc:3037] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.214738 5456 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.214879 5456 ts_tablet_manager.cc:1367] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20240501 14:02:25.215628 5456 raft_consensus.cc:348] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.215819 5456 raft_consensus.cc:374] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.215881 5456 raft_consensus.cc:729] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.216073 5456 consensus_queue.cc:260] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.216647 5456 ts_tablet_manager.cc:1398] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.216931 5456 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.218629 5456 tablet_bootstrap.cc:654] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.215823 5525 raft_consensus.cc:504] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.220266 5485 consensus_queue.cc:1035] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.220801 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.220965 5405 raft_consensus.cc:3037] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.223620 5405 raft_consensus.cc:2454] T 0a22dfec20f8497c9b42035a3ff7c92e P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.224682 5298 leader_election.cc:302] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.225945 5550 raft_consensus.cc:2781] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.226079 5550 raft_consensus.cc:686] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.226323 5550 consensus_queue.cc:237] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.227972 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a22dfec20f8497c9b42035a3ff7c92e" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.228260 5253 raft_consensus.cc:3037] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.229003 5511 consensus_queue.cc:1035] T 9ff5f7f90f4440d792cbd722f41aa240 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.231353 5253 raft_consensus.cc:2454] T 0a22dfec20f8497c9b42035a3ff7c92e P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.245546 5525 leader_election.cc:288] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.245935 5332 raft_consensus.cc:3037] T cf222bcb0e12403da462db45e174042f P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.249861 5477 consensus_queue.cc:1035] T cf222bcb0e12403da462db45e174042f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.262176 5525 raft_consensus.cc:482] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.262441 5525 raft_consensus.cc:504] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.263763 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.264006 5253 raft_consensus.cc:2454] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.264508 5299 leader_election.cc:302] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.264851 5521 raft_consensus.cc:2781] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.264972 5521 raft_consensus.cc:482] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.265036 5521 raft_consensus.cc:3037] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.265452 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.265651 5407 raft_consensus.cc:2454] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.266080 5525 leader_election.cc:288] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.268374 5521 raft_consensus.cc:504] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.269574 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.269780 5253 raft_consensus.cc:3037] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.273065 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1025c6d7e15946158542ee55dc976531" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.273273 5407 raft_consensus.cc:3037] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.276945 5253 raft_consensus.cc:2454] T 1025c6d7e15946158542ee55dc976531 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.277428 5521 leader_election.cc:288] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.277572 5299 leader_election.cc:302] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.277747 5407 raft_consensus.cc:2454] T 1025c6d7e15946158542ee55dc976531 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.278396 5543 raft_consensus.cc:482] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.278539 5543 raft_consensus.cc:504] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.279209 5543 leader_election.cc:288] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.279577 5521 raft_consensus.cc:2781] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.279717 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.279744 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.279804 5521 raft_consensus.cc:686] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.280062 5521 consensus_queue.cc:237] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
W20240501 14:02:25.280253 5224 leader_election.cc:341] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:25.280678 5223 leader_election.cc:341] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.280776 5223 leader_election.cc:302] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.281198 5543 raft_consensus.cc:2726] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.286280 5543 raft_consensus.cc:482] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.286454 5543 raft_consensus.cc:504] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.287191 5543 leader_election.cc:288] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.287587 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:25.288115 5224 leader_election.cc:341] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.288457 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.288718 5405 raft_consensus.cc:2454] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.289253 5223 leader_election.cc:302] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.289850 5543 raft_consensus.cc:2781] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.289937 5543 raft_consensus.cc:482] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.290000 5543 raft_consensus.cc:3037] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.293985 5525 consensus_queue.cc:1035] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.294821 5543 raft_consensus.cc:504] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.295867 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
W20240501 14:02:25.296491 5224 leader_election.cc:341] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.297140 5543 leader_election.cc:288] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.297428 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.297652 5405 raft_consensus.cc:3037] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.300729 5405 raft_consensus.cc:2454] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:25.301241 5223 leader_election.cc:302] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.301795 5543 raft_consensus.cc:2781] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.302047 5543 raft_consensus.cc:686] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:25.302374 5543 consensus_queue.cc:237] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.311133 5470 consensus_queue.cc:1035] T cb23750de77847ee96aa43bab357ebd1 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.318113 5155 catalog_manager.cc:5484] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.321386 5448 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.321655 5448 ts_tablet_manager.cc:1367] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.116s user 0.065s sys 0.044s
I20240501 14:02:25.322417 5449 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.322189 5154 catalog_manager.cc:5484] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.322542 5449 ts_tablet_manager.cc:1367] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.115s user 0.019s sys 0.026s
I20240501 14:02:25.322474 5448 raft_consensus.cc:348] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.322628 5448 raft_consensus.cc:374] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.322697 5448 raft_consensus.cc:729] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.322921 5448 consensus_queue.cc:260] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.323097 5449 raft_consensus.cc:348] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.323271 5449 raft_consensus.cc:374] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.323323 5449 raft_consensus.cc:729] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.323561 5448 ts_tablet_manager.cc:1398] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.323546 5449 consensus_queue.cc:260] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.323863 5448 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.324123 5449 ts_tablet_manager.cc:1398] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.324410 5449 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.325579 5448 tablet_bootstrap.cc:654] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.326925 5449 tablet_bootstrap.cc:654] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.327549 5448 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.327692 5448 ts_tablet_manager.cc:1367] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:02:25.327741 5157 catalog_manager.cc:5484] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.328418 5448 raft_consensus.cc:348] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.328624 5448 raft_consensus.cc:374] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.328691 5448 raft_consensus.cc:729] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.328919 5448 consensus_queue.cc:260] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.329401 5448 ts_tablet_manager.cc:1398] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.330439 5456 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.330580 5456 ts_tablet_manager.cc:1367] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.114s user 0.037s sys 0.035s
I20240501 14:02:25.331210 5449 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.331281 5456 raft_consensus.cc:348] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.331409 5449 ts_tablet_manager.cc:1367] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240501 14:02:25.331635 5448 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.332279 5449 raft_consensus.cc:348] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.332531 5449 raft_consensus.cc:374] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.332635 5449 raft_consensus.cc:729] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.332896 5449 consensus_queue.cc:260] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.333281 5448 tablet_bootstrap.cc:654] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.331494 5456 raft_consensus.cc:374] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.333634 5456 raft_consensus.cc:729] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.333941 5456 consensus_queue.cc:260] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.333555 5449 ts_tablet_manager.cc:1398] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:25.334817 5449 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.335333 5456 ts_tablet_manager.cc:1398] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 14:02:25.336687 5456 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.337163 5449 tablet_bootstrap.cc:654] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.338325 5456 tablet_bootstrap.cc:654] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.343686 5456 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.343863 5456 ts_tablet_manager.cc:1367] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20240501 14:02:25.344761 5456 raft_consensus.cc:348] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.344993 5456 raft_consensus.cc:374] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.345043 5456 raft_consensus.cc:729] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.345300 5456 consensus_queue.cc:260] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.346786 5456 ts_tablet_manager.cc:1398] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:02:25.347095 5456 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.349081 5456 tablet_bootstrap.cc:654] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.351133 5449 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.351372 5449 ts_tablet_manager.cc:1367] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.017s user 0.013s sys 0.002s
I20240501 14:02:25.352262 5449 raft_consensus.cc:348] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.352562 5449 raft_consensus.cc:374] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.352659 5449 raft_consensus.cc:729] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.352957 5449 consensus_queue.cc:260] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.353631 5449 ts_tablet_manager.cc:1398] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.353989 5449 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.355963 5449 tablet_bootstrap.cc:654] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.358875 5456 tablet_bootstrap.cc:492] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.358933 5449 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.359031 5456 ts_tablet_manager.cc:1367] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20240501 14:02:25.359054 5449 ts_tablet_manager.cc:1367] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:02:25.359321 5448 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.359440 5448 ts_tablet_manager.cc:1367] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.030s user 0.016s sys 0.011s
I20240501 14:02:25.359673 5449 raft_consensus.cc:348] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.359838 5449 raft_consensus.cc:374] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.359747 5456 raft_consensus.cc:348] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.359890 5449 raft_consensus.cc:729] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.359915 5456 raft_consensus.cc:374] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.359977 5456 raft_consensus.cc:729] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.360033 5448 raft_consensus.cc:348] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.360198 5448 raft_consensus.cc:374] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.360113 5449 consensus_queue.cc:260] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.360271 5448 raft_consensus.cc:729] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.360206 5456 consensus_queue.cc:260] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.360435 5448 consensus_queue.cc:260] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.360700 5456 ts_tablet_manager.cc:1398] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 14:02:25.360709 5449 ts_tablet_manager.cc:1398] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.360874 5448 ts_tablet_manager.cc:1398] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 14:02:25.361003 5449 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.361039 5456 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.361063 5448 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.362798 5456 tablet_bootstrap.cc:654] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.362798 5448 tablet_bootstrap.cc:654] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.362918 5449 tablet_bootstrap.cc:654] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.367338 5543 raft_consensus.cc:482] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.367516 5543 raft_consensus.cc:504] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.368324 5543 leader_election.cc:288] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.369047 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.369277 5334 raft_consensus.cc:2379] T 169a7db122934566b091f2379c6e3a04 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:25.369316 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169a7db122934566b091f2379c6e3a04" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.370116 5223 leader_election.cc:302] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.370640 5477 raft_consensus.cc:3037] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.372354 5543 raft_consensus.cc:482] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.372475 5543 raft_consensus.cc:504] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.373037 5543 leader_election.cc:288] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.373373 5477 raft_consensus.cc:2726] T 169a7db122934566b091f2379c6e3a04 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.373792 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7286a556f2ac4573a52b45a29f4352c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.373996 5407 raft_consensus.cc:2454] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.374001 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7286a556f2ac4573a52b45a29f4352c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.374372 5334 raft_consensus.cc:2454] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.374744 5224 leader_election.cc:302] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.376950 5477 raft_consensus.cc:2781] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.377046 5477 raft_consensus.cc:482] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.377110 5477 raft_consensus.cc:3037] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.379951 5477 raft_consensus.cc:504] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.382565 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7286a556f2ac4573a52b45a29f4352c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.382771 5334 raft_consensus.cc:3037] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.385864 5334 raft_consensus.cc:2454] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:25.386476 5224 leader_election.cc:302] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.387023 5552 raft_consensus.cc:2781] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.387138 5552 raft_consensus.cc:686] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:25.387414 5552 consensus_queue.cc:237] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.389899 5476 consensus_queue.cc:1035] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.400403 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7286a556f2ac4573a52b45a29f4352c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.400700 5405 raft_consensus.cc:3037] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.403829 5405 raft_consensus.cc:2454] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:25.405908 5511 consensus_queue.cc:1035] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.411172 5477 leader_election.cc:288] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.442416 5511 raft_consensus.cc:482] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.442572 5511 raft_consensus.cc:504] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.443205 5511 leader_election.cc:288] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.443742 5334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.443930 5334 raft_consensus.cc:2454] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.444382 5373 leader_election.cc:302] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.444780 5511 raft_consensus.cc:2781] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.444873 5511 raft_consensus.cc:482] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.444937 5511 raft_consensus.cc:3037] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.445165 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.445338 5255 raft_consensus.cc:2454] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.447626 5511 raft_consensus.cc:504] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.448791 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.449012 5255 raft_consensus.cc:3037] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.449070 5476 consensus_queue.cc:1035] T 57e68e51675e4d6a8167536678298504 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.451707 5255 raft_consensus.cc:2454] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.452128 5373 leader_election.cc:302] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.452808 5511 leader_election.cc:288] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.452873 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d5b2fbe1f043e3923e2012d65c2c09" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.452993 5511 raft_consensus.cc:2781] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.453131 5330 raft_consensus.cc:3037] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.456066 5330 raft_consensus.cc:2454] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.456548 5511 raft_consensus.cc:686] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:25.457212 5511 consensus_queue.cc:237] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.463830 5155 catalog_manager.cc:5484] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.476420 5521 raft_consensus.cc:482] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.476611 5521 raft_consensus.cc:504] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.477360 5521 leader_election.cc:288] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.477972 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8718449d6e4240ec8e54633aa87f7625" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.478183 5255 raft_consensus.cc:2454] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.476061 5157 catalog_manager.cc:5484] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.478619 5299 leader_election.cc:302] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.478967 5521 raft_consensus.cc:2781] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.479069 5521 raft_consensus.cc:482] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.479172 5521 raft_consensus.cc:3037] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.481822 5521 raft_consensus.cc:504] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.482797 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8718449d6e4240ec8e54633aa87f7625" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.482997 5255 raft_consensus.cc:3037] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.484365 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8718449d6e4240ec8e54633aa87f7625" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.484562 5405 raft_consensus.cc:2454] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.485994 5255 raft_consensus.cc:2454] T 8718449d6e4240ec8e54633aa87f7625 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.486755 5299 leader_election.cc:302] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.487074 5550 raft_consensus.cc:2781] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.487246 5550 raft_consensus.cc:686] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.487553 5550 consensus_queue.cc:237] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.487527 5521 leader_election.cc:288] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.489812 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8718449d6e4240ec8e54633aa87f7625" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.490036 5405 raft_consensus.cc:3037] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.493615 5405 raft_consensus.cc:2454] T 8718449d6e4240ec8e54633aa87f7625 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.495151 5608 raft_consensus.cc:482] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.495329 5608 raft_consensus.cc:504] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.495967 5608 leader_election.cc:288] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.497031 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.497757 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
W20240501 14:02:25.497929 5373 leader_election.cc:341] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.498279 5452 consensus_queue.cc:1035] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 14:02:25.500028 5373 leader_election.cc:341] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.500244 5373 leader_election.cc:302] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.500777 5605 raft_consensus.cc:2726] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.502264 5477 raft_consensus.cc:482] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.503903 5521 raft_consensus.cc:482] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.508988 5521 raft_consensus.cc:504] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.509737 5521 leader_election.cc:288] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.510071 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.510470 5477 raft_consensus.cc:504] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.511116 5259 raft_consensus.cc:2454] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.511588 5299 leader_election.cc:302] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.511993 5521 raft_consensus.cc:2781] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.512111 5521 raft_consensus.cc:482] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.512231 5521 raft_consensus.cc:3037] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.515189 5521 raft_consensus.cc:504] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.516525 5470 raft_consensus.cc:482] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.516671 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.516731 5470 raft_consensus.cc:504] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.516887 5259 raft_consensus.cc:3037] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.517354 5470 leader_election.cc:288] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.519034 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.519255 5406 raft_consensus.cc:2454] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.519960 5259 raft_consensus.cc:2454] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.520144 5298 leader_election.cc:302] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.520470 5550 raft_consensus.cc:2781] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.520592 5550 raft_consensus.cc:482] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.520700 5550 raft_consensus.cc:3037] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.521924 5521 leader_election.cc:288] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.522179 5477 leader_election.cc:288] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.523614 5550 raft_consensus.cc:504] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.525768 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.526191 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.526628 5299 leader_election.cc:302] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.527077 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.527192 5550 leader_election.cc:288] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.527458 5470 raft_consensus.cc:2781] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.527604 5470 raft_consensus.cc:686] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.527925 5470 consensus_queue.cc:237] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
W20240501 14:02:25.529855 5298 leader_election.cc:341] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:25.530135 5223 leader_election.cc:341] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.530411 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.530611 5406 raft_consensus.cc:3037] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.533411 5406 raft_consensus.cc:2454] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.534065 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.535610 5298 leader_election.cc:302] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.535903 5521 raft_consensus.cc:2781] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.536226 5521 raft_consensus.cc:686] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
W20240501 14:02:25.536391 5299 leader_election.cc:341] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.536554 5521 consensus_queue.cc:237] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.537669 5224 leader_election.cc:302] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.538183 5461 raft_consensus.cc:2726] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.539103 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
W20240501 14:02:25.535786 5206 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20240501 14:02:25.541265 5299 leader_election.cc:341] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.544919 5485 consensus_queue.cc:1035] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.555289 5608 consensus_queue.cc:1035] T 169a7db122934566b091f2379c6e3a04 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.564018 5550 consensus_queue.cc:1035] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.574966 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
W20240501 14:02:25.575989 5298 leader_election.cc:341] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.598817 5525 consensus_queue.cc:1035] T 3a60c4f4da7f4cd29be5695a78825784 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.611003 5449 tablet_bootstrap.cc:492] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.611230 5449 ts_tablet_manager.cc:1367] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.250s user 0.068s sys 0.112s
I20240501 14:02:25.611275 5448 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.611425 5448 ts_tablet_manager.cc:1367] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.250s user 0.082s sys 0.118s
I20240501 14:02:25.612023 5448 raft_consensus.cc:348] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.612025 5449 raft_consensus.cc:348] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.612339 5448 raft_consensus.cc:374] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.612363 5449 raft_consensus.cc:374] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.612430 5448 raft_consensus.cc:729] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.612533 5449 raft_consensus.cc:729] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.612783 5448 consensus_queue.cc:260] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.612807 5449 consensus_queue.cc:260] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.613394 5449 ts_tablet_manager.cc:1398] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.613740 5449 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.615502 5449 tablet_bootstrap.cc:654] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.615463 5448 ts_tablet_manager.cc:1398] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:25.615449 5157 catalog_manager.cc:5484] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.615875 5448 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.616492 5157 catalog_manager.cc:5484] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.617646 5448 tablet_bootstrap.cc:654] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.618269 5449 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.618429 5449 ts_tablet_manager.cc:1367] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 14:02:25.618530 5157 catalog_manager.cc:5484] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.619194 5448 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.619313 5448 ts_tablet_manager.cc:1367] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240501 14:02:25.619930 5448 raft_consensus.cc:348] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.620107 5448 raft_consensus.cc:374] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.620157 5448 raft_consensus.cc:729] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.620417 5448 consensus_queue.cc:260] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.620996 5448 ts_tablet_manager.cc:1398] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 14:02:25.621243 5448 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.622375 5448 tablet_bootstrap.cc:654] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.624787 5608 raft_consensus.cc:482] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.624917 5608 raft_consensus.cc:504] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.625049 5456 tablet_bootstrap.cc:492] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.625162 5456 ts_tablet_manager.cc:1367] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.264s user 0.097s sys 0.127s
I20240501 14:02:25.625485 5608 leader_election.cc:288] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.625782 5456 raft_consensus.cc:348] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.625941 5456 raft_consensus.cc:374] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.625979 5456 raft_consensus.cc:729] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.626153 5456 consensus_queue.cc:260] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.626318 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.626519 5259 raft_consensus.cc:2379] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b5d87b866b04909a7d8d16ea5b25483 in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:25.626471 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32aa0719fcbe4ce2af3113452bb72901" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.626633 5456 ts_tablet_manager.cc:1398] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 14:02:25.626865 5456 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.626963 5608 raft_consensus.cc:482] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.627071 5608 raft_consensus.cc:504] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.627164 5373 leader_election.cc:302] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.627550 5511 raft_consensus.cc:3037] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.627625 5608 leader_election.cc:288] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.628288 5448 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.628407 5448 ts_tablet_manager.cc:1367] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20240501 14:02:25.628823 5456 tablet_bootstrap.cc:654] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.630156 5511 raft_consensus.cc:2726] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.630247 5448 raft_consensus.cc:348] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.630412 5448 raft_consensus.cc:374] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.630478 5448 raft_consensus.cc:729] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.630574 5449 raft_consensus.cc:348] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.630775 5449 raft_consensus.cc:374] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.630847 5449 raft_consensus.cc:729] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.630749 5448 consensus_queue.cc:260] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.631052 5449 consensus_queue.cc:260] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.631328 5456 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.631497 5456 ts_tablet_manager.cc:1367] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 14:02:25.631652 5449 ts_tablet_manager.cc:1398] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 14:02:25.631770 5448 ts_tablet_manager.cc:1398] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:25.631929 5449 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.632082 5448 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.632390 5456 raft_consensus.cc:348] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.632702 5456 raft_consensus.cc:374] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.632771 5456 raft_consensus.cc:729] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.633087 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.633252 5259 raft_consensus.cc:2454] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.632948 5456 consensus_queue.cc:260] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.633698 5373 leader_election.cc:302] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.633776 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.634024 5608 raft_consensus.cc:2781] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.634109 5608 raft_consensus.cc:482] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.634181 5608 raft_consensus.cc:3037] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
W20240501 14:02:25.634218 5373 leader_election.cc:341] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.635697 5456 ts_tablet_manager.cc:1398] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:25.636149 5456 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.638778 5608 raft_consensus.cc:504] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.639425 5608 leader_election.cc:288] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.639786 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.640045 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.640223 5253 raft_consensus.cc:3037] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
W20240501 14:02:25.640264 5373 leader_election.cc:341] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.642254 5456 tablet_bootstrap.cc:654] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.642297 5449 tablet_bootstrap.cc:654] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.642946 5253 raft_consensus.cc:2454] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.643853 5448 tablet_bootstrap.cc:654] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.643803 5373 leader_election.cc:302] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters: 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.644096 5608 raft_consensus.cc:2781] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.644572 5608 raft_consensus.cc:686] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:25.644863 5608 consensus_queue.cc:237] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.648317 5456 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.648480 5456 ts_tablet_manager.cc:1367] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20240501 14:02:25.649260 5456 raft_consensus.cc:348] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.649441 5456 raft_consensus.cc:374] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.649492 5456 raft_consensus.cc:729] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.650095 5449 tablet_bootstrap.cc:492] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.650264 5449 ts_tablet_manager.cc:1367] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20240501 14:02:25.650588 5448 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.650696 5448 ts_tablet_manager.cc:1367] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20240501 14:02:25.650895 5449 raft_consensus.cc:348] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.651021 5449 raft_consensus.cc:374] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.651049 5449 raft_consensus.cc:729] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.651223 5449 consensus_queue.cc:260] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.651319 5448 raft_consensus.cc:348] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.651481 5448 raft_consensus.cc:374] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.651531 5448 raft_consensus.cc:729] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.651681 5449 ts_tablet_manager.cc:1398] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 14:02:25.651691 5448 consensus_queue.cc:260] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.650095 5456 consensus_queue.cc:260] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.652249 5456 ts_tablet_manager.cc:1398] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:25.652333 5448 ts_tablet_manager.cc:1398] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.652514 5456 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.652551 5448 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.652596 5157 catalog_manager.cc:5484] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.653343 5449 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.655007 5449 tablet_bootstrap.cc:654] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.655143 5456 tablet_bootstrap.cc:654] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.657596 5448 tablet_bootstrap.cc:654] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.667855 5456 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.668049 5456 ts_tablet_manager.cc:1367] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.003s
I20240501 14:02:25.669397 5448 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.669550 5448 ts_tablet_manager.cc:1367] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.005s
I20240501 14:02:25.669406 5456 raft_consensus.cc:348] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.669759 5456 raft_consensus.cc:374] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.669802 5456 raft_consensus.cc:729] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.670033 5456 consensus_queue.cc:260] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.670419 5449 tablet_bootstrap.cc:492] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.670542 5449 ts_tablet_manager.cc:1367] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.008s
I20240501 14:02:25.670538 5456 ts_tablet_manager.cc:1398] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.670516 5448 raft_consensus.cc:348] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.670701 5448 raft_consensus.cc:374] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.670753 5448 raft_consensus.cc:729] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.670908 5456 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.670953 5448 consensus_queue.cc:260] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.671175 5449 raft_consensus.cc:348] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.671334 5449 raft_consensus.cc:374] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.671377 5449 raft_consensus.cc:729] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.671397 5448 ts_tablet_manager.cc:1398] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.671581 5449 consensus_queue.cc:260] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.671783 5448 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.673632 5448 tablet_bootstrap.cc:654] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.674396 5456 tablet_bootstrap.cc:654] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.678799 5521 consensus_queue.cc:1035] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.679553 5552 raft_consensus.cc:482] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.679685 5552 raft_consensus.cc:504] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.680533 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.680711 5330 raft_consensus.cc:2454] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.681102 5552 leader_election.cc:288] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.681604 5224 leader_election.cc:302] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.681629 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.681833 5407 raft_consensus.cc:2454] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.682240 5552 raft_consensus.cc:2781] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.682328 5552 raft_consensus.cc:482] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.682386 5552 raft_consensus.cc:3037] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.685281 5456 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.685462 5456 ts_tablet_manager.cc:1367] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20240501 14:02:25.685489 5552 raft_consensus.cc:504] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.686302 5456 raft_consensus.cc:348] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.686498 5456 raft_consensus.cc:374] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.686547 5456 raft_consensus.cc:729] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.686698 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.686759 5456 consensus_queue.cc:260] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.686883 5330 raft_consensus.cc:3037] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.686719 5449 ts_tablet_manager.cc:1398] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20240501 14:02:25.687299 5449 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.687491 5456 ts_tablet_manager.cc:1398] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240501 14:02:25.687845 5456 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.688531 5552 leader_election.cc:288] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.688985 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a17f01f800ae4100b1effa705cf531c6" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.689163 5407 raft_consensus.cc:3037] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.689527 5525 consensus_queue.cc:1035] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.692291 5330 raft_consensus.cc:2454] T a17f01f800ae4100b1effa705cf531c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:25.693058 5407 raft_consensus.cc:2454] T a17f01f800ae4100b1effa705cf531c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:25.693264 5456 tablet_bootstrap.cc:654] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.694144 5224 leader_election.cc:302] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.694537 5461 raft_consensus.cc:2781] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.694697 5461 raft_consensus.cc:686] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:25.695472 5461 consensus_queue.cc:237] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.708933 5470 consensus_queue.cc:1035] T 0a22dfec20f8497c9b42035a3ff7c92e P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240501 14:02:25.711019 5470 raft_consensus.cc:482] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.711165 5470 raft_consensus.cc:504] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.714798 5448 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.714965 5448 ts_tablet_manager.cc:1367] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.043s user 0.028s sys 0.012s
I20240501 14:02:25.715782 5448 raft_consensus.cc:348] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.715986 5448 raft_consensus.cc:374] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.716032 5448 raft_consensus.cc:729] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.716324 5448 consensus_queue.cc:260] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.716575 5550 consensus_queue.cc:1035] T 1025c6d7e15946158542ee55dc976531 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.716967 5448 ts_tablet_manager.cc:1398] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.717289 5448 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.722187 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.725466 5470 leader_election.cc:288] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.725948 5477 raft_consensus.cc:482] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.726114 5477 raft_consensus.cc:504] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.729787 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.729538 5477 leader_election.cc:288] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.730821 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e812adb37a6849e0881bcc1abb248aa9" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.731014 5406 raft_consensus.cc:2379] T e812adb37a6849e0881bcc1abb248aa9 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 1f109496867240cab78f9407ecbacf73 in this term.
I20240501 14:02:25.731423 5223 leader_election.cc:302] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:25.733299 5477 raft_consensus.cc:3037] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.733614 5449 tablet_bootstrap.cc:654] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.734607 5156 catalog_manager.cc:5484] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.736244 5477 raft_consensus.cc:2726] T e812adb37a6849e0881bcc1abb248aa9 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.737787 5405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a065dab27a4f8a953b2154d14d06da" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.738032 5405 raft_consensus.cc:2379] T 18a065dab27a4f8a953b2154d14d06da P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate bc68bd81bd5144d9bbcde254c8963fdc in this term.
I20240501 14:02:25.738509 5298 leader_election.cc:302] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.738994 5477 consensus_queue.cc:1035] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.739133 5470 raft_consensus.cc:3037] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.741623 5470 raft_consensus.cc:2726] T 18a065dab27a4f8a953b2154d14d06da P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.742527 5448 tablet_bootstrap.cc:654] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.754009 5449 tablet_bootstrap.cc:492] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.754189 5449 ts_tablet_manager.cc:1367] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.003s
I20240501 14:02:25.754985 5449 raft_consensus.cc:348] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.755218 5449 raft_consensus.cc:374] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.755266 5449 raft_consensus.cc:729] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.755571 5449 consensus_queue.cc:260] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.756148 5449 ts_tablet_manager.cc:1398] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.756461 5449 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.758039 5449 tablet_bootstrap.cc:654] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.762588 5456 tablet_bootstrap.cc:492] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.762753 5456 ts_tablet_manager.cc:1367] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.075s user 0.007s sys 0.007s
I20240501 14:02:25.763511 5456 raft_consensus.cc:348] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.763792 5456 raft_consensus.cc:374] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.763865 5456 raft_consensus.cc:729] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.764077 5456 consensus_queue.cc:260] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.764709 5449 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.764853 5449 ts_tablet_manager.cc:1367] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20240501 14:02:25.765627 5449 raft_consensus.cc:348] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.765825 5449 raft_consensus.cc:374] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.765877 5449 raft_consensus.cc:729] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.766104 5449 consensus_queue.cc:260] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.767506 5456 ts_tablet_manager.cc:1398] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 14:02:25.767812 5456 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.769459 5456 tablet_bootstrap.cc:654] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.771168 5449 ts_tablet_manager.cc:1398] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20240501 14:02:25.771298 5456 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.771430 5456 ts_tablet_manager.cc:1367] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:02:25.771487 5449 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.772117 5456 raft_consensus.cc:348] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.772372 5456 raft_consensus.cc:374] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.772445 5456 raft_consensus.cc:729] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.772679 5456 consensus_queue.cc:260] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.773538 5448 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.773674 5448 ts_tablet_manager.cc:1367] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.012s
I20240501 14:02:25.774391 5448 raft_consensus.cc:348] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.774605 5448 raft_consensus.cc:374] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.774662 5448 raft_consensus.cc:729] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.774858 5448 consensus_queue.cc:260] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.775380 5448 ts_tablet_manager.cc:1398] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:25.775502 5456 ts_tablet_manager.cc:1398] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:02:25.775655 5448 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.775756 5456 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.777426 5448 tablet_bootstrap.cc:654] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.778470 5449 tablet_bootstrap.cc:654] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.778472 5470 raft_consensus.cc:482] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.778628 5470 raft_consensus.cc:504] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.779126 5470 leader_election.cc:288] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.779814 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3709ce4d5d845d3863fe71b6b5a77a3" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.780303 5259 raft_consensus.cc:2454] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.780788 5299 leader_election.cc:302] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.781157 5470 raft_consensus.cc:2781] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.781270 5470 raft_consensus.cc:482] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.781335 5470 raft_consensus.cc:3037] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.781848 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3709ce4d5d845d3863fe71b6b5a77a3" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.782034 5407 raft_consensus.cc:2454] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.782586 5456 tablet_bootstrap.cc:654] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.784158 5470 raft_consensus.cc:504] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.785737 5477 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.786947 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3709ce4d5d845d3863fe71b6b5a77a3" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.787146 5259 raft_consensus.cc:3037] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.788409 5511 raft_consensus.cc:482] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.788547 5511 raft_consensus.cc:504] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.789223 5511 leader_election.cc:288] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.790036 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af53f955ad24b1b8b4c748924354d67" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.790254 5330 raft_consensus.cc:2454] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.790815 5373 leader_election.cc:302] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.791203 5608 raft_consensus.cc:2781] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.791281 5608 raft_consensus.cc:482] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.791340 5608 raft_consensus.cc:3037] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.785259 5456 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.792559 5456 ts_tablet_manager.cc:1367] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20240501 14:02:25.794279 5456 raft_consensus.cc:348] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.794492 5456 raft_consensus.cc:374] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.794401 5608 raft_consensus.cc:504] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.794596 5456 raft_consensus.cc:729] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.794842 5456 consensus_queue.cc:260] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.796351 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af53f955ad24b1b8b4c748924354d67" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.796578 5255 raft_consensus.cc:3037] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.799778 5255 raft_consensus.cc:2454] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.796072 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af53f955ad24b1b8b4c748924354d67" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.800276 5253 raft_consensus.cc:2362] T 3af53f955ad24b1b8b4c748924354d67 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1. Re-sending same reply.
I20240501 14:02:25.800613 5456 ts_tablet_manager.cc:1398] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240501 14:02:25.800999 5373 leader_election.cc:302] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.801699 5511 raft_consensus.cc:2781] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.801856 5511 raft_consensus.cc:686] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:25.802204 5511 consensus_queue.cc:237] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.805374 5608 leader_election.cc:288] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.808377 5259 raft_consensus.cc:2454] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.809526 5299 leader_election.cc:302] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.809895 5550 raft_consensus.cc:2781] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.810038 5550 raft_consensus.cc:686] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.810364 5550 consensus_queue.cc:237] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.812412 5470 leader_election.cc:288] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.812678 5608 raft_consensus.cc:482] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.805465 5456 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.805971 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af53f955ad24b1b8b4c748924354d67" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.813109 5330 raft_consensus.cc:3037] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.813349 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3709ce4d5d845d3863fe71b6b5a77a3" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.813566 5408 raft_consensus.cc:3037] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.814716 5456 tablet_bootstrap.cc:654] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.816323 5330 raft_consensus.cc:2454] T 3af53f955ad24b1b8b4c748924354d67 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.818125 5408 raft_consensus.cc:2454] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.819820 5448 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.819669 5155 catalog_manager.cc:5484] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.819964 5448 ts_tablet_manager.cc:1367] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.007s
I20240501 14:02:25.820998 5449 tablet_bootstrap.cc:492] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.821171 5449 ts_tablet_manager.cc:1367] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.009s
I20240501 14:02:25.812903 5608 raft_consensus.cc:504] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.822912 5449 raft_consensus.cc:348] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.823125 5449 raft_consensus.cc:374] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.823248 5449 raft_consensus.cc:729] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.823498 5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c81d276fcaa44ae2877fafee9d08d725" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.823926 5259 raft_consensus.cc:2454] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.824402 5448 raft_consensus.cc:348] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.824458 5373 leader_election.cc:302] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.824622 5448 raft_consensus.cc:374] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.824735 5448 raft_consensus.cc:729] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.824887 5452 raft_consensus.cc:2781] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.824986 5452 raft_consensus.cc:482] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.824954 5448 consensus_queue.cc:260] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.825086 5452 raft_consensus.cc:3037] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.825500 5448 ts_tablet_manager.cc:1398] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240501 14:02:25.825800 5448 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.827535 5448 tablet_bootstrap.cc:654] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.828305 5543 consensus_queue.cc:1035] T 18a065dab27a4f8a953b2154d14d06da P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.828083 5452 raft_consensus.cc:504] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.830610 5452 leader_election.cc:288] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.831398 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c81d276fcaa44ae2877fafee9d08d725" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.831631 5253 raft_consensus.cc:3037] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.831924 5543 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.832422 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c81d276fcaa44ae2877fafee9d08d725" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.832612 5330 raft_consensus.cc:3037] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.838333 5253 raft_consensus.cc:2454] T c81d276fcaa44ae2877fafee9d08d725 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.839359 5605 raft_consensus.cc:482] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.839533 5605 raft_consensus.cc:504] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.840598 5605 leader_election.cc:288] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.840929 5485 raft_consensus.cc:482] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.841104 5485 raft_consensus.cc:504] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.841459 5448 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.841641 5448 ts_tablet_manager.cc:1367] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.002s
I20240501 14:02:25.841758 5485 leader_election.cc:288] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.841959 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.842530 5373 leader_election.cc:302] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.842455 5448 raft_consensus.cc:348] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.843004 5448 raft_consensus.cc:374] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.843097 5448 raft_consensus.cc:729] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.843333 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.843564 5332 raft_consensus.cc:2454] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:25.843508 5448 consensus_queue.cc:260] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.843858 5485 raft_consensus.cc:2781] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.843988 5485 raft_consensus.cc:686] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
W20240501 14:02:25.844027 5373 leader_election.cc:341] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.844229 5448 ts_tablet_manager.cc:1398] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 14:02:25.844300 5373 leader_election.cc:302] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:25.844575 5448 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.845006 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.844300 5485 consensus_queue.cc:237] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.844997 5769 raft_consensus.cc:2781] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.845366 5769 raft_consensus.cc:482] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.845495 5769 raft_consensus.cc:3037] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.846486 5448 tablet_bootstrap.cc:654] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.848277 5769 raft_consensus.cc:504] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.848938 5769 leader_election.cc:288] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.848999 5448 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.849223 5448 ts_tablet_manager.cc:1367] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20240501 14:02:25.849658 5330 raft_consensus.cc:2454] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.850035 5448 raft_consensus.cc:348] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.850523 5448 raft_consensus.cc:374] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.850667 5448 raft_consensus.cc:729] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.850896 5448 consensus_queue.cc:260] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.851454 5448 ts_tablet_manager.cc:1398] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20240501 14:02:25.851487 5373 leader_election.cc:341] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.851778 5448 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.852330 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.853088 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.853576 5448 tablet_bootstrap.cc:654] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.853704 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:25.853957 5330 raft_consensus.cc:3037] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
W20240501 14:02:25.856508 5373 leader_election.cc:341] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
W20240501 14:02:25.856869 5373 leader_election.cc:341] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.857044 5373 leader_election.cc:302] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483; no voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.857900 5485 raft_consensus.cc:2726] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.858409 5608 leader_election.cc:288] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:25.859401 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c81d276fcaa44ae2877fafee9d08d725" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:25.859664 5332 raft_consensus.cc:2362] T c81d276fcaa44ae2877fafee9d08d725 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1. Re-sending same reply.
I20240501 14:02:25.861378 5448 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.861553 5448 ts_tablet_manager.cc:1367] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20240501 14:02:25.861858 5330 raft_consensus.cc:2454] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:25.862265 5373 leader_election.cc:302] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters: bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.862314 5448 raft_consensus.cc:348] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.862540 5448 raft_consensus.cc:374] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.862629 5608 raft_consensus.cc:2781] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.862843 5608 raft_consensus.cc:686] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:25.823493 5449 consensus_queue.cc:260] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.863109 5608 consensus_queue.cc:237] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.863858 5449 ts_tablet_manager.cc:1398] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20240501 14:02:25.864673 5449 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.862636 5448 raft_consensus.cc:729] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.865926 5448 consensus_queue.cc:260] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.866991 5448 ts_tablet_manager.cc:1398] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 14:02:25.867313 5448 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483: Bootstrap starting.
I20240501 14:02:25.867565 5449 tablet_bootstrap.cc:654] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.868938 5448 tablet_bootstrap.cc:654] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.872354 5449 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.875099 5155 catalog_manager.cc:5484] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.875617 5449 ts_tablet_manager.cc:1367] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
I20240501 14:02:25.876611 5449 raft_consensus.cc:348] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.876853 5449 raft_consensus.cc:374] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.876933 5449 raft_consensus.cc:729] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.877182 5449 consensus_queue.cc:260] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.878327 5449 ts_tablet_manager.cc:1398] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:02:25.878489 5456 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.878662 5456 ts_tablet_manager.cc:1367] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.073s user 0.031s sys 0.023s
I20240501 14:02:25.878688 5449 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.879374 5456 raft_consensus.cc:348] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.879607 5456 raft_consensus.cc:374] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.879688 5456 raft_consensus.cc:729] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.879910 5456 consensus_queue.cc:260] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.880717 5456 ts_tablet_manager.cc:1398] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.881039 5456 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.881247 5525 consensus_queue.cc:1035] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.882122 5448 tablet_bootstrap.cc:492] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483: No bootstrap required, opened a new log
I20240501 14:02:25.882269 5448 ts_tablet_manager.cc:1367] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20240501 14:02:25.882640 5456 tablet_bootstrap.cc:654] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.883047 5448 raft_consensus.cc:348] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.883245 5448 raft_consensus.cc:374] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.883458 5448 raft_consensus.cc:729] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.883723 5448 consensus_queue.cc:260] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.884431 5448 ts_tablet_manager.cc:1398] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.884886 5449 tablet_bootstrap.cc:654] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.887218 5456 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.887387 5456 ts_tablet_manager.cc:1367] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.005s
I20240501 14:02:25.888111 5456 raft_consensus.cc:348] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.888353 5456 raft_consensus.cc:374] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.888447 5456 raft_consensus.cc:729] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.888670 5456 consensus_queue.cc:260] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.889256 5456 ts_tablet_manager.cc:1398] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:25.889536 5456 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.889628 5449 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.889752 5449 ts_tablet_manager.cc:1367] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240501 14:02:25.890547 5449 raft_consensus.cc:348] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.890739 5449 raft_consensus.cc:374] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.890830 5449 raft_consensus.cc:729] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.891072 5449 consensus_queue.cc:260] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.891265 5456 tablet_bootstrap.cc:654] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.891716 5449 ts_tablet_manager.cc:1398] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:25.892508 5521 consensus_queue.cc:1035] T 8718449d6e4240ec8e54633aa87f7625 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.897541 5155 catalog_manager.cc:5484] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.898236 5456 tablet_bootstrap.cc:492] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.898420 5456 ts_tablet_manager.cc:1367] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20240501 14:02:25.898304 5155 catalog_manager.cc:5484] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:25.899206 5456 raft_consensus.cc:348] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.899430 5456 raft_consensus.cc:374] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.899523 5456 raft_consensus.cc:729] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.899755 5456 consensus_queue.cc:260] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.900439 5456 ts_tablet_manager.cc:1398] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.900766 5456 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.902390 5456 tablet_bootstrap.cc:654] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.902653 5449 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.904374 5449 tablet_bootstrap.cc:654] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.905233 5456 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.905406 5456 ts_tablet_manager.cc:1367] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20240501 14:02:25.906309 5521 raft_consensus.cc:482] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.906231 5456 raft_consensus.cc:348] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.906493 5456 raft_consensus.cc:374] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.906487 5521 raft_consensus.cc:504] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.906651 5456 raft_consensus.cc:729] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.906942 5456 consensus_queue.cc:260] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.907277 5521 leader_election.cc:288] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.907644 5456 ts_tablet_manager.cc:1398] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 14:02:25.907963 5456 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.907892 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.908144 5253 raft_consensus.cc:2379] T 5dc3b18a3914454aa31c111dba67ed47 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f109496867240cab78f9407ecbacf73 in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:25.909124 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dc3b18a3914454aa31c111dba67ed47" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.909606 5298 leader_election.cc:302] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f109496867240cab78f9407ecbacf73; no voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc
I20240501 14:02:25.909706 5456 tablet_bootstrap.cc:654] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.910113 5521 raft_consensus.cc:3037] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.913520 5470 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.915596 5521 raft_consensus.cc:2726] T 5dc3b18a3914454aa31c111dba67ed47 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:25.915688 5449 tablet_bootstrap.cc:492] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.917260 5449 ts_tablet_manager.cc:1367] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.003s
I20240501 14:02:25.918066 5449 raft_consensus.cc:348] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.918323 5456 tablet_bootstrap.cc:492] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.918330 5449 raft_consensus.cc:374] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.918552 5456 ts_tablet_manager.cc:1367] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20240501 14:02:25.919431 5449 raft_consensus.cc:729] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.919620 5456 raft_consensus.cc:348] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.919878 5456 raft_consensus.cc:374] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.919970 5456 raft_consensus.cc:729] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.920233 5456 consensus_queue.cc:260] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.920332 5449 consensus_queue.cc:260] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.920873 5449 ts_tablet_manager.cc:1398] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:02:25.920876 5456 ts_tablet_manager.cc:1398] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 14:02:25.921218 5449 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.921248 5456 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc: Bootstrap starting.
I20240501 14:02:25.922909 5456 tablet_bootstrap.cc:654] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.922909 5449 tablet_bootstrap.cc:654] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.923516 5550 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.925839 5608 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.940263 5521 raft_consensus.cc:482] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.940502 5521 raft_consensus.cc:504] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.941193 5521 leader_election.cc:288] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.941262 5550 consensus_queue.cc:1035] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.941551 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5e6f81c0344dd98ed536563b784bf5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:25.941741 5255 raft_consensus.cc:2454] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.942117 5299 leader_election.cc:302] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.942150 5407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5e6f81c0344dd98ed536563b784bf5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.942365 5407 raft_consensus.cc:2454] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:25.943238 5470 raft_consensus.cc:2781] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.943342 5470 raft_consensus.cc:482] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.943459 5470 raft_consensus.cc:3037] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.946152 5470 raft_consensus.cc:504] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.947991 5255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5e6f81c0344dd98ed536563b784bf5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:25.948228 5255 raft_consensus.cc:3037] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.951311 5255 raft_consensus.cc:2454] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.953752 5485 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.955533 5299 leader_election.cc:302] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.955832 5550 raft_consensus.cc:2781] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:25.955984 5550 raft_consensus.cc:686] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:25.956336 5550 consensus_queue.cc:237] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.958638 5476 raft_consensus.cc:482] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:25.958828 5476 raft_consensus.cc:504] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.959444 5476 leader_election.cc:288] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.960023 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c92911631b1342ba9e020fd73c191980" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:25.960263 5408 raft_consensus.cc:2454] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:25.960703 5223 leader_election.cc:302] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:25.961040 5476 raft_consensus.cc:2781] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:25.961143 5476 raft_consensus.cc:482] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:25.961272 5476 raft_consensus.cc:3037] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.964145 5476 raft_consensus.cc:504] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.964864 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c92911631b1342ba9e020fd73c191980" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
W20240501 14:02:25.967962 5224 leader_election.cc:341] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): Illegal state: must be running to vote when last-logged opid is not known
I20240501 14:02:25.972801 5521 consensus_queue.cc:1035] T e812adb37a6849e0881bcc1abb248aa9 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:25.973148 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5e6f81c0344dd98ed536563b784bf5" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:25.973300 5408 raft_consensus.cc:3037] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:25.975931 5408 raft_consensus.cc:2454] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:25.976418 5470 leader_election.cc:288] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:25.983547 5449 tablet_bootstrap.cc:492] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.983711 5449 ts_tablet_manager.cc:1367] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.041s
I20240501 14:02:25.984978 5449 raft_consensus.cc:348] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.985226 5449 raft_consensus.cc:374] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.985277 5449 raft_consensus.cc:729] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.985508 5449 consensus_queue.cc:260] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.986033 5449 ts_tablet_manager.cc:1398] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 14:02:25.986330 5449 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.983748 5456 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc: No bootstrap required, opened a new log
I20240501 14:02:25.986964 5456 ts_tablet_manager.cc:1367] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent bootstrapping tablet: real 0.066s user 0.018s sys 0.036s
I20240501 14:02:25.988476 5449 tablet_bootstrap.cc:654] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.989251 5456 raft_consensus.cc:348] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.989456 5456 raft_consensus.cc:374] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.989509 5456 raft_consensus.cc:729] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.989719 5456 consensus_queue.cc:260] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.990279 5456 ts_tablet_manager.cc:1398] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 14:02:25.991374 5449 tablet_bootstrap.cc:492] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.991544 5449 ts_tablet_manager.cc:1367] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20240501 14:02:25.992295 5449 raft_consensus.cc:348] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.992590 5449 raft_consensus.cc:374] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.992691 5449 raft_consensus.cc:729] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.992954 5449 consensus_queue.cc:260] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.994181 5449 ts_tablet_manager.cc:1398] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 14:02:25.994472 5449 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:25.996129 5449 tablet_bootstrap.cc:654] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:25.997923 5449 tablet_bootstrap.cc:492] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:25.998055 5449 ts_tablet_manager.cc:1367] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 14:02:25.998821 5449 raft_consensus.cc:348] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.999032 5449 raft_consensus.cc:374] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:25.999089 5449 raft_consensus.cc:729] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:25.999293 5449 consensus_queue.cc:260] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:25.999459 5157 catalog_manager.cc:5484] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:25.999789 5449 ts_tablet_manager.cc:1398] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:26.000034 5449 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73: Bootstrap starting.
I20240501 14:02:26.001629 5449 tablet_bootstrap.cc:654] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73: Neither blocks nor log segments found. Creating new log.
I20240501 14:02:26.003444 5449 tablet_bootstrap.cc:492] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73: No bootstrap required, opened a new log
I20240501 14:02:26.003561 5449 ts_tablet_manager.cc:1367] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:02:26.004257 5449 raft_consensus.cc:348] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.004438 5449 raft_consensus.cc:374] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:02:26.004490 5449 raft_consensus.cc:729] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Initialized, Role: FOLLOWER
I20240501 14:02:26.004642 5449 consensus_queue.cc:260] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.005115 5449 ts_tablet_manager.cc:1398] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 14:02:26.009534 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c92911631b1342ba9e020fd73c191980" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.009567 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c92911631b1342ba9e020fd73c191980" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:26.009683 5330 raft_consensus.cc:3037] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.009752 5406 raft_consensus.cc:3037] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.011778 5330 raft_consensus.cc:2454] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.011775 5406 raft_consensus.cc:2454] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.009368 5476 leader_election.cc:288] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.012228 5224 leader_election.cc:302] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.012454 5476 raft_consensus.cc:2781] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.012571 5476 raft_consensus.cc:686] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:26.012789 5476 consensus_queue.cc:237] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.015522 5157 catalog_manager.cc:5484] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:26.024572 5452 raft_consensus.cc:482] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.024783 5452 raft_consensus.cc:504] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.025321 5452 leader_election.cc:288] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:26.025746 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02c56c9e7d0c409795b52d9ebdf2d32a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.025727 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02c56c9e7d0c409795b52d9ebdf2d32a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:26.025975 5253 raft_consensus.cc:2454] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:26.025959 5330 raft_consensus.cc:2454] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:26.026360 5373 leader_election.cc:302] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:26.026573 5452 raft_consensus.cc:2781] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.026646 5452 raft_consensus.cc:482] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.026690 5452 raft_consensus.cc:3037] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.028616 5452 raft_consensus.cc:504] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.029103 5452 leader_election.cc:288] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:26.029513 5253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02c56c9e7d0c409795b52d9ebdf2d32a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:26.029513 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02c56c9e7d0c409795b52d9ebdf2d32a" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.029708 5330 raft_consensus.cc:3037] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.031638 5330 raft_consensus.cc:2454] T 02c56c9e7d0c409795b52d9ebdf2d32a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:26.029721 5253 raft_consensus.cc:3037] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.031970 5373 leader_election.cc:302] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:26.032205 5452 raft_consensus.cc:2781] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.032326 5452 raft_consensus.cc:686] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:26.032565 5452 consensus_queue.cc:237] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.034140 5253 raft_consensus.cc:2454] T 02c56c9e7d0c409795b52d9ebdf2d32a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:26.035712 5157 catalog_manager.cc:5484] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:26.101051 5452 consensus_queue.cc:1035] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.105489 5485 consensus_queue.cc:1035] T 5dc3b18a3914454aa31c111dba67ed47 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.110498 5476 raft_consensus.cc:482] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.110716 5476 raft_consensus.cc:504] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.111377 5476 leader_election.cc:288] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.111781 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.112011 5332 raft_consensus.cc:2379] T 35bdf6ec90ce49ea9237042c1849db2a P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc68bd81bd5144d9bbcde254c8963fdc in current term 1: Already voted for candidate 0b5d87b866b04909a7d8d16ea5b25483 in this term.
I20240501 14:02:26.112114 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35bdf6ec90ce49ea9237042c1849db2a" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:26.112636 5223 leader_election.cc:302] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc68bd81bd5144d9bbcde254c8963fdc; no voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73
I20240501 14:02:26.112900 5476 raft_consensus.cc:3037] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.113116 5461 consensus_queue.cc:1035] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.115223 5476 raft_consensus.cc:2726] T 35bdf6ec90ce49ea9237042c1849db2a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 14:02:26.117115 5476 consensus_queue.cc:1035] T a17f01f800ae4100b1effa705cf531c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.131090 5461 raft_consensus.cc:482] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.131265 5461 raft_consensus.cc:504] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.131871 5461 leader_election.cc:288] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.132331 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5011d7ebf1c4953aaf028ff5fbfb13e" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.132402 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5011d7ebf1c4953aaf028ff5fbfb13e" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:26.132510 5332 raft_consensus.cc:2454] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.132539 5408 raft_consensus.cc:2454] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.132863 5224 leader_election.cc:302] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.133078 5461 raft_consensus.cc:2781] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.133154 5461 raft_consensus.cc:482] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.133211 5461 raft_consensus.cc:3037] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.135316 5461 raft_consensus.cc:504] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.135811 5461 leader_election.cc:288] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.136159 5550 raft_consensus.cc:482] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.136231 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5011d7ebf1c4953aaf028ff5fbfb13e" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:26.136240 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5011d7ebf1c4953aaf028ff5fbfb13e" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.136394 5408 raft_consensus.cc:3037] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.136327 5550 raft_consensus.cc:504] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.136440 5332 raft_consensus.cc:3037] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.136929 5550 leader_election.cc:288] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.137341 5406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c0dc399e44ac3b1a2af885428ea46" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:26.137531 5406 raft_consensus.cc:2454] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:26.137379 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c0dc399e44ac3b1a2af885428ea46" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:26.137755 5254 raft_consensus.cc:2454] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 0.
I20240501 14:02:26.137916 5298 leader_election.cc:302] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:26.138163 5550 raft_consensus.cc:2781] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.138239 5550 raft_consensus.cc:482] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.138291 5550 raft_consensus.cc:3037] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.138792 5408 raft_consensus.cc:2454] T e5011d7ebf1c4953aaf028ff5fbfb13e P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.139020 5332 raft_consensus.cc:2454] T e5011d7ebf1c4953aaf028ff5fbfb13e P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.139084 5223 leader_election.cc:302] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.139309 5461 raft_consensus.cc:2781] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.139427 5461 raft_consensus.cc:686] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:26.139667 5461 consensus_queue.cc:237] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.141081 5550 raft_consensus.cc:504] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.141687 5550 leader_election.cc:288] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.142026 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c0dc399e44ac3b1a2af885428ea46" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:26.142074 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587c0dc399e44ac3b1a2af885428ea46" candidate_uuid: "1f109496867240cab78f9407ecbacf73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:26.142185 5254 raft_consensus.cc:3037] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.142263 5408 raft_consensus.cc:3037] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.142961 5157 catalog_manager.cc:5484] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:26.144307 5408 raft_consensus.cc:2454] T 587c0dc399e44ac3b1a2af885428ea46 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:26.144557 5254 raft_consensus.cc:2454] T 587c0dc399e44ac3b1a2af885428ea46 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f109496867240cab78f9407ecbacf73 in term 1.
I20240501 14:02:26.144731 5298 leader_election.cc:302] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:26.144994 5550 raft_consensus.cc:2781] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.145138 5550 raft_consensus.cc:686] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Becoming Leader. State: Replica: 1f109496867240cab78f9407ecbacf73, State: Running, Role: LEADER
I20240501 14:02:26.145349 5550 consensus_queue.cc:237] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.148149 5157 catalog_manager.cc:5484] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f109496867240cab78f9407ecbacf73 (127.4.14.130). New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:26.150313 5461 raft_consensus.cc:482] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.150450 5461 raft_consensus.cc:504] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.151134 5461 leader_election.cc:288] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.151379 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848215fa967849659cac8e5043ade761" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:26.151609 5408 raft_consensus.cc:2454] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.151975 5223 leader_election.cc:302] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.152257 5461 raft_consensus.cc:2781] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.152343 5461 raft_consensus.cc:482] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.152412 5461 raft_consensus.cc:3037] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.151576 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848215fa967849659cac8e5043ade761" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.153666 5332 raft_consensus.cc:2454] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.154879 5461 raft_consensus.cc:504] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.155444 5461 leader_election.cc:288] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.155942 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848215fa967849659cac8e5043ade761" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:26.156298 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848215fa967849659cac8e5043ade761" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.156445 5332 raft_consensus.cc:3037] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.156550 5408 raft_consensus.cc:3037] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.158679 5332 raft_consensus.cc:2454] T 848215fa967849659cac8e5043ade761 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.158929 5408 raft_consensus.cc:2454] T 848215fa967849659cac8e5043ade761 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.158998 5224 leader_election.cc:302] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f109496867240cab78f9407ecbacf73, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.159240 5476 raft_consensus.cc:2781] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.159348 5476 raft_consensus.cc:686] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:26.159562 5476 consensus_queue.cc:237] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.162616 5157 catalog_manager.cc:5484] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:26.197813 5452 raft_consensus.cc:482] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.197996 5452 raft_consensus.cc:504] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.198511 5452 leader_election.cc:288] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:26.198982 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186e4fa8faf4984a9f83ec965a810b4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" is_pre_election: true
I20240501 14:02:26.199015 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186e4fa8faf4984a9f83ec965a810b4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.199151 5332 raft_consensus.cc:2454] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:26.199157 5254 raft_consensus.cc:2454] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 0.
I20240501 14:02:26.199520 5373 leader_election.cc:302] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, 1f109496867240cab78f9407ecbacf73; no voters:
I20240501 14:02:26.199745 5452 raft_consensus.cc:2781] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.199831 5452 raft_consensus.cc:482] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.199899 5452 raft_consensus.cc:3037] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.200695 5476 raft_consensus.cc:482] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 14:02:26.200837 5476 raft_consensus.cc:504] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.201421 5476 leader_election.cc:288] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.201766 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73" is_pre_election: true
I20240501 14:02:26.201817 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483" is_pre_election: true
I20240501 14:02:26.201933 5332 raft_consensus.cc:2454] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.201974 5408 raft_consensus.cc:2454] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 0.
I20240501 14:02:26.202323 5223 leader_election.cc:302] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.202555 5476 raft_consensus.cc:2781] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 14:02:26.202665 5476 raft_consensus.cc:482] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 14:02:26.202555 5452 raft_consensus.cc:504] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.202740 5476 raft_consensus.cc:3037] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.203176 5452 leader_election.cc:288] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Requested vote from peers bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507), 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:26.203532 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186e4fa8faf4984a9f83ec965a810b4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc68bd81bd5144d9bbcde254c8963fdc"
I20240501 14:02:26.203553 5332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186e4fa8faf4984a9f83ec965a810b4" candidate_uuid: "0b5d87b866b04909a7d8d16ea5b25483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.203708 5332 raft_consensus.cc:3037] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.203706 5254 raft_consensus.cc:3037] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.205356 5476 raft_consensus.cc:504] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.205636 5254 raft_consensus.cc:2454] T 4186e4fa8faf4984a9f83ec965a810b4 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:26.205925 5476 leader_election.cc:288] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Requested vote from peers 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859), 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:26.206144 5373 leader_election.cc:302] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.206212 5332 raft_consensus.cc:2454] T 4186e4fa8faf4984a9f83ec965a810b4 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5d87b866b04909a7d8d16ea5b25483 in term 1.
I20240501 14:02:26.206368 5452 raft_consensus.cc:2781] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.206341 5330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f109496867240cab78f9407ecbacf73"
I20240501 14:02:26.206477 5330 raft_consensus.cc:3037] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.206646 5408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e6281c4a6f48f89ce15de7116ef7bc" candidate_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5d87b866b04909a7d8d16ea5b25483"
I20240501 14:02:26.206784 5452 raft_consensus.cc:686] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d87b866b04909a7d8d16ea5b25483, State: Running, Role: LEADER
I20240501 14:02:26.206859 5408 raft_consensus.cc:3037] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:02:26.207051 5452 consensus_queue.cc:237] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.208978 5408 raft_consensus.cc:2454] T 94e6281c4a6f48f89ce15de7116ef7bc P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.209048 5330 raft_consensus.cc:2454] T 94e6281c4a6f48f89ce15de7116ef7bc P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc68bd81bd5144d9bbcde254c8963fdc in term 1.
I20240501 14:02:26.209307 5223 leader_election.cc:302] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5d87b866b04909a7d8d16ea5b25483, bc68bd81bd5144d9bbcde254c8963fdc; no voters:
I20240501 14:02:26.209527 5476 raft_consensus.cc:2781] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:02:26.209726 5476 raft_consensus.cc:686] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Becoming Leader. State: Replica: bc68bd81bd5144d9bbcde254c8963fdc, State: Running, Role: LEADER
I20240501 14:02:26.209983 5476 consensus_queue.cc:237] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } }
I20240501 14:02:26.210337 5157 catalog_manager.cc:5484] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131). New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } }
I20240501 14:02:26.210623 5452 consensus_queue.cc:1035] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.213936 5155 catalog_manager.cc:5484] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: term changed from 0 to 1, leader changed from <none> to bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129). New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:26.215008 5485 consensus_queue.cc:1035] T 3af53f955ad24b1b8b4c748924354d67 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.302425 5525 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.306613 5550 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.307559 5452 consensus_queue.cc:1035] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.313943 5452 consensus_queue.cc:1035] T c81d276fcaa44ae2877fafee9d08d725 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.358909 5452 consensus_queue.cc:1035] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.363476 5485 consensus_queue.cc:1035] T 35bdf6ec90ce49ea9237042c1849db2a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.431938 5525 consensus_queue.cc:1035] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.435855 5470 consensus_queue.cc:1035] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.546270 5476 consensus_queue.cc:1035] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.550246 5477 consensus_queue.cc:1035] T 848215fa967849659cac8e5043ade761 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.550678 5470 consensus_queue.cc:1035] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.558406 5521 consensus_queue.cc:1035] T 587c0dc399e44ac3b1a2af885428ea46 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.574864 5476 consensus_queue.cc:1035] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.578637 5477 consensus_queue.cc:1035] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.610808 5511 consensus_queue.cc:1035] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.615497 5452 consensus_queue.cc:1035] T 02c56c9e7d0c409795b52d9ebdf2d32a P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.639581 5477 consensus_queue.cc:1035] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.643605 5476 consensus_queue.cc:1035] T 94e6281c4a6f48f89ce15de7116ef7bc P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.700592 5477 consensus_queue.cc:1035] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.704164 5477 consensus_queue.cc:1035] T e5011d7ebf1c4953aaf028ff5fbfb13e P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.713593 5452 consensus_queue.cc:1035] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.717849 5485 consensus_queue.cc:1035] T 4186e4fa8faf4984a9f83ec965a810b4 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 14:02:26.873208 4154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:02:26.876619 5831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:26.901939 5834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:02:26.902556 5832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:02:26.906044 4154 server_base.cc:1034] running on GCE node
I20240501 14:02:26.906493 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:02:26.906567 4154 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:02:26.906594 4154 hybrid_clock.cc:648] HybridClock initialized: now 1714572146906589 us; error 0 us; skew 500 ppm
I20240501 14:02:26.906728 4154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:02:26.908092 4154 webserver.cc:460] Webserver started at http://127.4.14.132:37787/ using document root <none> and password file <none>
I20240501 14:02:26.908355 4154 fs_manager.cc:359] Metadata directory not provided
I20240501 14:02:26.908423 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:02:26.908521 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:02:26.909189 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-3-root/instance:
uuid: "b111fc283a294f5cbc564d60d2b45f93"
format_stamp: "Formatted at 2024-05-01 14:02:26 on dist-test-slave-78f7"
I20240501 14:02:26.911748 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:26.913532 5839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:26.913981 4154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 14:02:26.914083 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-3-root
uuid: "b111fc283a294f5cbc564d60d2b45f93"
format_stamp: "Formatted at 2024-05-01 14:02:26 on dist-test-slave-78f7"
I20240501 14:02:26.914208 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:02:26.927299 4154 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:02:26.927989 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:02:26.928568 4154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:02:26.929500 4154 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:02:26.929558 4154 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:26.929644 4154 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:02:26.929678 4154 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:02:26.950173 4154 rpc_server.cc:307] RPC server started. Bound to: 127.4.14.132:44613
I20240501 14:02:26.950192 5901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.14.132:44613 every 8 connection(s)
I20240501 14:02:26.951223 4154 auto_leader_rebalancer-test.cc:405] add a tserver: b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:26.957537 5902 heartbeater.cc:347] Connected to a master server at 127.4.14.190:34741
I20240501 14:02:26.957831 5902 heartbeater.cc:464] Registering TS with master...
I20240501 14:02:26.958279 5902 heartbeater.cc:511] Master 127.4.14.190:34741 requested a full tablet report, sending...
I20240501 14:02:26.959194 5155 ts_manager.cc:194] Registered new tserver with Master: b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613)
I20240501 14:02:26.959964 5155 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52720
I20240501 14:02:27.602718 5330 consensus_queue.cc:237] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:27.605544 5253 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.605572 5408 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.606375 5909 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.606680 5550 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.609644 5909 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.610327 5253 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
W20240501 14:02:27.614337 5299 consensus_peers.cc:485] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32aa0719fcbe4ce2af3113452bb72901. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:27.614154 5408 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.624825 5156 catalog_manager.cc:5484] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.638361 5254 consensus_queue.cc:237] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:27.641677 5407 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.642264 5461 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.643442 5330 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.643958 5461 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.645323 5476 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.645854 5407 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.649119 5330 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.651460 5155 catalog_manager.cc:5484] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
W20240501 14:02:27.657670 5224 consensus_peers.cc:485] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7b0d70a8e37426e8e6f7d11501a1ed1. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:27.658890 5330 consensus_queue.cc:237] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:27.661021 5254 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.661059 5407 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 14:02:27.661058 5299 consensus_peers.cc:485] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3709ce4d5d845d3863fe71b6b5a77a3. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:27.661526 5909 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.661792 5550 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.664399 5550 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.665526 5407 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.669024 5254 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.669883 5253 consensus_queue.cc:237] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:27.670312 5157 catalog_manager.cc:5484] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:27.672437 5330 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 14:02:27.672772 5224 consensus_peers.cc:485] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07d904a12cde4e98a7f409f7f0868eae. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:27.673128 5408 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:27.673743 5477 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.676559 5476 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:27.676918 5461 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.678853 5407 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.687067 5156 catalog_manager.cc:5484] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:27.702996 5330 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:27.961465 5902 heartbeater.cc:503] Master 127.4.14.190:34741 was elected leader, sending a full tablet report...
I20240501 14:02:28.011201 5930 ts_tablet_manager.cc:902] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:28.013348 5930 tablet_copy_client.cc:308] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.130:41859
I20240501 14:02:28.021497 5344 tablet_copy_service.cc:140] P 1f109496867240cab78f9407ecbacf73: Received BeginTabletCopySession request for tablet 32aa0719fcbe4ce2af3113452bb72901 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:59182)
I20240501 14:02:28.021739 5344 tablet_copy_service.cc:161] P 1f109496867240cab78f9407ecbacf73: Beginning new tablet copy session on tablet 32aa0719fcbe4ce2af3113452bb72901 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:59182: session id = b111fc283a294f5cbc564d60d2b45f93-32aa0719fcbe4ce2af3113452bb72901
I20240501 14:02:28.025244 5344 tablet_copy_source_session.cc:205] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:28.027151 5930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32aa0719fcbe4ce2af3113452bb72901. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:28.033768 5930 tablet_copy_client.cc:783] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:28.034078 5930 tablet_copy_client.cc:647] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:28.036135 5930 tablet_copy_client.cc:523] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:28.040392 5930 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:28.048249 5930 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:28.048738 5930 tablet_bootstrap.cc:492] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:28.049027 5930 ts_tablet_manager.cc:1367] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20240501 14:02:28.049860 5930 raft_consensus.cc:348] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.050134 5930 raft_consensus.cc:729] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:28.050335 5930 consensus_queue.cc:260] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.051121 5930 ts_tablet_manager.cc:1398] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 14:02:28.051903 5344 tablet_copy_service.cc:342] P 1f109496867240cab78f9407ecbacf73: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-32aa0719fcbe4ce2af3113452bb72901 received from {username='slave'} at 127.0.0.1:59182
I20240501 14:02:28.052222 5344 tablet_copy_service.cc:433] P 1f109496867240cab78f9407ecbacf73: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-32aa0719fcbe4ce2af3113452bb72901 on tablet 32aa0719fcbe4ce2af3113452bb72901 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:28.120569 5930 ts_tablet_manager.cc:902] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:28.132632 5940 ts_tablet_manager.cc:902] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:28.134423 5940 tablet_copy_client.cc:308] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.129:34507
I20240501 14:02:28.142570 5930 tablet_copy_client.cc:308] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.130:41859
I20240501 14:02:28.142850 5269 tablet_copy_service.cc:140] P bc68bd81bd5144d9bbcde254c8963fdc: Received BeginTabletCopySession request for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:60508)
I20240501 14:02:28.143023 5269 tablet_copy_service.cc:161] P bc68bd81bd5144d9bbcde254c8963fdc: Beginning new tablet copy session on tablet a7b0d70a8e37426e8e6f7d11501a1ed1 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:60508: session id = b111fc283a294f5cbc564d60d2b45f93-a7b0d70a8e37426e8e6f7d11501a1ed1
I20240501 14:02:28.144531 5344 tablet_copy_service.cc:140] P 1f109496867240cab78f9407ecbacf73: Received BeginTabletCopySession request for tablet d3709ce4d5d845d3863fe71b6b5a77a3 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:59182)
I20240501 14:02:28.144682 5344 tablet_copy_service.cc:161] P 1f109496867240cab78f9407ecbacf73: Beginning new tablet copy session on tablet d3709ce4d5d845d3863fe71b6b5a77a3 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:59182: session id = b111fc283a294f5cbc564d60d2b45f93-d3709ce4d5d845d3863fe71b6b5a77a3
I20240501 14:02:28.145121 5269 tablet_copy_source_session.cc:205] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:28.146323 5940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b0d70a8e37426e8e6f7d11501a1ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:28.147229 5344 tablet_copy_source_session.cc:205] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:28.148346 5930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3709ce4d5d845d3863fe71b6b5a77a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:28.152395 5940 tablet_copy_client.cc:783] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:28.152642 5940 tablet_copy_client.cc:647] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:28.154470 5930 tablet_copy_client.cc:783] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:28.154688 5930 tablet_copy_client.cc:647] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:28.155531 5940 tablet_copy_client.cc:523] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:28.156494 5930 tablet_copy_client.cc:523] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:28.158896 5940 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:28.159884 5930 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:28.165093 5940 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:28.165436 5940 tablet_bootstrap.cc:492] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:28.165557 5930 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:28.165653 5940 ts_tablet_manager.cc:1367] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.006s
I20240501 14:02:28.165912 5930 tablet_bootstrap.cc:492] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:28.166121 5930 ts_tablet_manager.cc:1367] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240501 14:02:28.166386 5940 raft_consensus.cc:348] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.166577 5940 raft_consensus.cc:729] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:28.166704 5930 raft_consensus.cc:348] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.166874 5930 raft_consensus.cc:729] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:28.166760 5940 consensus_queue.cc:260] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.167114 5930 consensus_queue.cc:260] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.167891 5930 ts_tablet_manager.cc:1398] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240501 14:02:28.168300 5940 ts_tablet_manager.cc:1398] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:02:28.168653 5344 tablet_copy_service.cc:342] P 1f109496867240cab78f9407ecbacf73: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-d3709ce4d5d845d3863fe71b6b5a77a3 received from {username='slave'} at 127.0.0.1:59182
I20240501 14:02:28.168741 5344 tablet_copy_service.cc:433] P 1f109496867240cab78f9407ecbacf73: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-d3709ce4d5d845d3863fe71b6b5a77a3 on tablet d3709ce4d5d845d3863fe71b6b5a77a3 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:28.169521 5269 tablet_copy_service.cc:342] P bc68bd81bd5144d9bbcde254c8963fdc: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-a7b0d70a8e37426e8e6f7d11501a1ed1 received from {username='slave'} at 127.0.0.1:60508
I20240501 14:02:28.169605 5269 tablet_copy_service.cc:433] P bc68bd81bd5144d9bbcde254c8963fdc: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-a7b0d70a8e37426e8e6f7d11501a1ed1 on tablet a7b0d70a8e37426e8e6f7d11501a1ed1 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:28.225821 5940 ts_tablet_manager.cc:902] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:28.227308 5940 tablet_copy_client.cc:308] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.129:34507
I20240501 14:02:28.227914 5269 tablet_copy_service.cc:140] P bc68bd81bd5144d9bbcde254c8963fdc: Received BeginTabletCopySession request for tablet 07d904a12cde4e98a7f409f7f0868eae from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:60508)
I20240501 14:02:28.228035 5269 tablet_copy_service.cc:161] P bc68bd81bd5144d9bbcde254c8963fdc: Beginning new tablet copy session on tablet 07d904a12cde4e98a7f409f7f0868eae from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:60508: session id = b111fc283a294f5cbc564d60d2b45f93-07d904a12cde4e98a7f409f7f0868eae
I20240501 14:02:28.230459 5269 tablet_copy_source_session.cc:205] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:28.231458 5940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07d904a12cde4e98a7f409f7f0868eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:28.236703 5940 tablet_copy_client.cc:783] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:28.236896 5940 tablet_copy_client.cc:647] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:28.238267 5940 tablet_copy_client.cc:523] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:28.240780 5940 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:28.245676 5940 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:28.245990 5940 tablet_bootstrap.cc:492] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:28.246201 5940 ts_tablet_manager.cc:1367] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20240501 14:02:28.246795 5940 raft_consensus.cc:348] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.246978 5940 raft_consensus.cc:729] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:28.247155 5940 consensus_queue.cc:260] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:28.247607 5940 ts_tablet_manager.cc:1398] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 14:02:28.248230 5269 tablet_copy_service.cc:342] P bc68bd81bd5144d9bbcde254c8963fdc: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-07d904a12cde4e98a7f409f7f0868eae received from {username='slave'} at 127.0.0.1:60508
I20240501 14:02:28.248342 5269 tablet_copy_service.cc:433] P bc68bd81bd5144d9bbcde254c8963fdc: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-07d904a12cde4e98a7f409f7f0868eae on tablet 07d904a12cde4e98a7f409f7f0868eae with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:28.517912 5877 raft_consensus.cc:1203] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:28.644291 5877 raft_consensus.cc:1203] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:28.723637 5877 raft_consensus.cc:1203] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:28.735034 5877 raft_consensus.cc:1203] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:28.961169 5957 raft_consensus.cc:1050] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:28.962230 5957 consensus_queue.cc:237] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:28.964984 5877 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:28.965214 5259 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:28.965420 5407 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:28.965703 5525 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:28.966166 5525 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:28.966778 5525 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:28.970072 5525 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.973839 5877 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.975265 5407 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.976263 5156 catalog_manager.cc:5484] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:28.981369 5259 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.989722 5334 consensus_queue.cc:237] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:28.991559 5877 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:28.992012 5407 raft_consensus.cc:1261] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:28.992278 5962 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:28.992565 5525 consensus_queue.cc:1035] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:28.995054 5957 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.995913 5877 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:28.998637 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 32aa0719fcbe4ce2af3113452bb72901 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:28.999300 5407 raft_consensus.cc:2932] T 32aa0719fcbe4ce2af3113452bb72901 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.002198 5156 catalog_manager.cc:5484] T 32aa0719fcbe4ce2af3113452bb72901 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.006672 5243 tablet_service.cc:1514] Processing DeleteTablet for tablet 32aa0719fcbe4ce2af3113452bb72901 with delete_type TABLET_DATA_TOMBSTONED (TS bc68bd81bd5144d9bbcde254c8963fdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60472
I20240501 14:02:29.007548 5967 tablet_replica.cc:330] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: stopping tablet replica
I20240501 14:02:29.007875 5967 raft_consensus.cc:2229] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:29.008241 5967 raft_consensus.cc:2258] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:29.009356 5967 ts_tablet_manager.cc:1875] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:29.015905 5967 ts_tablet_manager.cc:1888] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:29.016083 5967 log.cc:1196] T 32aa0719fcbe4ce2af3113452bb72901 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/wals/32aa0719fcbe4ce2af3113452bb72901
I20240501 14:02:29.017010 5143 catalog_manager.cc:4830] TS bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): tablet 32aa0719fcbe4ce2af3113452bb72901 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:29.118067 5956 raft_consensus.cc:1050] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:29.118772 5956 consensus_queue.cc:237] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.121078 5877 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.121126 5408 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.121628 5476 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.121906 5477 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.125160 5334 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.125722 5969 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.127565 5956 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.128721 5877 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.132079 5407 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.134030 5155 catalog_manager.cc:5484] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.136042 5330 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.142590 5254 consensus_queue.cc:237] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.144294 5407 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.144795 5956 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.144862 5877 raft_consensus.cc:1261] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.146390 5956 consensus_queue.cc:1035] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.147504 5476 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.148321 5407 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.149046 5877 raft_consensus.cc:2932] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.151396 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:29.153602 5156 catalog_manager.cc:5484] T a7b0d70a8e37426e8e6f7d11501a1ed1 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.158035 5322 tablet_service.cc:1514] Processing DeleteTablet for tablet a7b0d70a8e37426e8e6f7d11501a1ed1 with delete_type TABLET_DATA_TOMBSTONED (TS 1f109496867240cab78f9407ecbacf73 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59158
I20240501 14:02:29.158706 5973 tablet_replica.cc:330] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: stopping tablet replica
I20240501 14:02:29.158919 5973 raft_consensus.cc:2229] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:29.159129 5973 raft_consensus.cc:2258] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:29.160517 5973 ts_tablet_manager.cc:1875] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:29.165885 5973 ts_tablet_manager.cc:1888] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:29.165997 5973 log.cc:1196] T a7b0d70a8e37426e8e6f7d11501a1ed1 P 1f109496867240cab78f9407ecbacf73: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/wals/a7b0d70a8e37426e8e6f7d11501a1ed1
I20240501 14:02:29.166664 5143 catalog_manager.cc:4830] TS 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): tablet a7b0d70a8e37426e8e6f7d11501a1ed1 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:29.277698 5525 raft_consensus.cc:1050] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:29.278553 5525 consensus_queue.cc:237] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.280706 5877 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.280733 5407 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.281270 5259 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.281212 5909 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.281749 5909 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.282402 5957 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.285394 5957 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.288476 5877 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.289546 5407 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.290446 5155 catalog_manager.cc:5484] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:29.292405 5254 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.295424 5334 consensus_queue.cc:237] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.298672 5254 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.299511 5957 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.300778 5876 raft_consensus.cc:1261] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.301525 5957 consensus_queue.cc:1035] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.303233 5962 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.304420 5877 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.306829 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d3709ce4d5d845d3863fe71b6b5a77a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:29.308837 5157 catalog_manager.cc:5484] T d3709ce4d5d845d3863fe71b6b5a77a3 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.310376 5254 raft_consensus.cc:2932] T d3709ce4d5d845d3863fe71b6b5a77a3 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.312126 5398 tablet_service.cc:1514] Processing DeleteTablet for tablet d3709ce4d5d845d3863fe71b6b5a77a3 with delete_type TABLET_DATA_TOMBSTONED (TS 0b5d87b866b04909a7d8d16ea5b25483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37984
I20240501 14:02:29.314584 5978 tablet_replica.cc:330] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: stopping tablet replica
I20240501 14:02:29.314851 5978 raft_consensus.cc:2229] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:29.315244 5978 raft_consensus.cc:2258] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:29.316614 5978 ts_tablet_manager.cc:1875] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:29.321667 5978 ts_tablet_manager.cc:1888] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:29.321794 5978 log.cc:1196] T d3709ce4d5d845d3863fe71b6b5a77a3 P 0b5d87b866b04909a7d8d16ea5b25483: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/wals/d3709ce4d5d845d3863fe71b6b5a77a3
I20240501 14:02:29.322427 5142 catalog_manager.cc:4830] TS 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): tablet d3709ce4d5d845d3863fe71b6b5a77a3 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:29.349932 5477 raft_consensus.cc:1050] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:29.350638 5477 consensus_queue.cc:237] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.352675 5877 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.352753 5407 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.353322 5334 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:29.353554 5477 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.354041 5477 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.354382 5476 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:29.358220 5476 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.360900 5407 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.363842 5157 catalog_manager.cc:5484] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:29.365365 5877 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.367624 5334 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.374208 5259 consensus_queue.cc:237] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:29.376289 5334 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.376796 5877 raft_consensus.cc:1261] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:29.376905 5476 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.377249 5969 consensus_queue.cc:1035] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:29.379581 5476 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.380129 5876 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.380676 5334 raft_consensus.cc:2932] T 07d904a12cde4e98a7f409f7f0868eae P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:29.383272 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 07d904a12cde4e98a7f409f7f0868eae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:29.385586 5157 catalog_manager.cc:5484] T 07d904a12cde4e98a7f409f7f0868eae P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:29.389276 5398 tablet_service.cc:1514] Processing DeleteTablet for tablet 07d904a12cde4e98a7f409f7f0868eae with delete_type TABLET_DATA_TOMBSTONED (TS 0b5d87b866b04909a7d8d16ea5b25483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37984
I20240501 14:02:29.389613 5978 tablet_replica.cc:330] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: stopping tablet replica
I20240501 14:02:29.389804 5978 raft_consensus.cc:2229] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:29.390012 5978 raft_consensus.cc:2258] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:29.390692 5978 ts_tablet_manager.cc:1875] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:29.395162 5978 ts_tablet_manager.cc:1888] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:29.395287 5978 log.cc:1196] T 07d904a12cde4e98a7f409f7f0868eae P 0b5d87b866b04909a7d8d16ea5b25483: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/wals/07d904a12cde4e98a7f409f7f0868eae
I20240501 14:02:29.395906 5142 catalog_manager.cc:4830] TS 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): tablet 07d904a12cde4e98a7f409f7f0868eae (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:30.410631 5407 consensus_queue.cc:237] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.414532 5334 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.415040 5254 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.415095 5986 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:30.415529 5949 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 14:02:30.421196 5373 consensus_peers.cc:485] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d14a452a4e14cfb9173b5d4e184ff6f. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:30.421662 5949 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.422370 5254 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.427670 5407 consensus_queue.cc:237] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.428011 5157 catalog_manager.cc:5484] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.432538 5254 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.432971 5330 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.433282 5452 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 14:02:30.433605 5373 consensus_peers.cc:485] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e89240009304303a397175ca656c512. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:30.434136 5452 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:30.434762 5330 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.441213 5949 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.442313 5254 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.449028 5334 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.450500 5254 consensus_queue.cc:237] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.453547 5155 catalog_manager.cc:5484] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.455976 5407 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.456568 5330 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.456626 5476 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 14:02:30.457248 5224 consensus_peers.cc:485] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7286a556f2ac4573a52b45a29f4352c6. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:30.457494 5476 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:30.460753 5476 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.461207 5334 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.465421 5407 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.466882 5157 catalog_manager.cc:5484] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.469350 5254 consensus_queue.cc:237] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
W20240501 14:02:30.472882 5224 consensus_peers.cc:485] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca91b0a4dc4a4221ab6f7e6167ade06f. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:30.473037 5334 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.473114 5407 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:30.473628 5476 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:30.474203 5476 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:30.476188 6003 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.476904 5334 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.477336 5407 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.482960 5155 catalog_manager.cc:5484] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:30.792343 6007 ts_tablet_manager.cc:902] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:30.793740 6007 tablet_copy_client.cc:308] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.131:35465
I20240501 14:02:30.799628 5418 tablet_copy_service.cc:140] P 0b5d87b866b04909a7d8d16ea5b25483: Received BeginTabletCopySession request for tablet 1d14a452a4e14cfb9173b5d4e184ff6f from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:45168)
I20240501 14:02:30.799800 5418 tablet_copy_service.cc:161] P 0b5d87b866b04909a7d8d16ea5b25483: Beginning new tablet copy session on tablet 1d14a452a4e14cfb9173b5d4e184ff6f from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:45168: session id = b111fc283a294f5cbc564d60d2b45f93-1d14a452a4e14cfb9173b5d4e184ff6f
I20240501 14:02:30.802568 5418 tablet_copy_source_session.cc:205] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:30.803772 6007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d14a452a4e14cfb9173b5d4e184ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:30.809006 6007 tablet_copy_client.cc:783] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:30.809226 6007 tablet_copy_client.cc:647] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:30.811192 6007 tablet_copy_client.cc:523] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:30.814190 6007 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:30.818985 6007 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:30.819310 6007 tablet_bootstrap.cc:492] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:30.819548 6007 ts_tablet_manager.cc:1367] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240501 14:02:30.820304 6007 raft_consensus.cc:348] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.820529 6007 raft_consensus.cc:729] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:30.820679 6007 consensus_queue.cc:260] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.821511 6007 ts_tablet_manager.cc:1398] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240501 14:02:30.822105 5418 tablet_copy_service.cc:342] P 0b5d87b866b04909a7d8d16ea5b25483: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-1d14a452a4e14cfb9173b5d4e184ff6f received from {username='slave'} at 127.0.0.1:45168
I20240501 14:02:30.822216 5418 tablet_copy_service.cc:433] P 0b5d87b866b04909a7d8d16ea5b25483: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-1d14a452a4e14cfb9173b5d4e184ff6f on tablet 1d14a452a4e14cfb9173b5d4e184ff6f with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:30.849648 6007 ts_tablet_manager.cc:902] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:30.850982 6007 tablet_copy_client.cc:308] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.129:34507
I20240501 14:02:30.851965 5269 tablet_copy_service.cc:140] P bc68bd81bd5144d9bbcde254c8963fdc: Received BeginTabletCopySession request for tablet ca91b0a4dc4a4221ab6f7e6167ade06f from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:60508)
I20240501 14:02:30.852118 5269 tablet_copy_service.cc:161] P bc68bd81bd5144d9bbcde254c8963fdc: Beginning new tablet copy session on tablet ca91b0a4dc4a4221ab6f7e6167ade06f from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:60508: session id = b111fc283a294f5cbc564d60d2b45f93-ca91b0a4dc4a4221ab6f7e6167ade06f
I20240501 14:02:30.854656 5269 tablet_copy_source_session.cc:205] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:30.855865 6007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca91b0a4dc4a4221ab6f7e6167ade06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:30.861208 6007 tablet_copy_client.cc:783] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:30.861438 6007 tablet_copy_client.cc:647] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:30.862892 6007 tablet_copy_client.cc:523] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:30.866099 6007 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:30.871935 6007 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:30.872377 6007 tablet_bootstrap.cc:492] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:30.872625 6007 ts_tablet_manager.cc:1367] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20240501 14:02:30.873281 6007 raft_consensus.cc:348] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.873456 6007 raft_consensus.cc:729] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:30.873569 6007 consensus_queue.cc:260] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.874869 6007 ts_tablet_manager.cc:1398] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 14:02:30.876485 5269 tablet_copy_service.cc:342] P bc68bd81bd5144d9bbcde254c8963fdc: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-ca91b0a4dc4a4221ab6f7e6167ade06f received from {username='slave'} at 127.0.0.1:60508
I20240501 14:02:30.876606 5269 tablet_copy_service.cc:433] P bc68bd81bd5144d9bbcde254c8963fdc: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-ca91b0a4dc4a4221ab6f7e6167ade06f on tablet ca91b0a4dc4a4221ab6f7e6167ade06f with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:30.911109 6007 ts_tablet_manager.cc:902] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:30.912336 6007 tablet_copy_client.cc:308] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.131:35465
I20240501 14:02:30.912933 5418 tablet_copy_service.cc:140] P 0b5d87b866b04909a7d8d16ea5b25483: Received BeginTabletCopySession request for tablet 3e89240009304303a397175ca656c512 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:45168)
I20240501 14:02:30.913102 5418 tablet_copy_service.cc:161] P 0b5d87b866b04909a7d8d16ea5b25483: Beginning new tablet copy session on tablet 3e89240009304303a397175ca656c512 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:45168: session id = b111fc283a294f5cbc564d60d2b45f93-3e89240009304303a397175ca656c512
I20240501 14:02:30.915807 5418 tablet_copy_source_session.cc:205] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:30.917019 6007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e89240009304303a397175ca656c512. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:30.921936 6007 tablet_copy_client.cc:783] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:30.922158 6007 tablet_copy_client.cc:647] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:30.924038 6007 tablet_copy_client.cc:523] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:30.926683 6007 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:30.931494 6007 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:30.931780 6007 tablet_bootstrap.cc:492] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:30.931998 6007 ts_tablet_manager.cc:1367] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.003s
I20240501 14:02:30.932706 6007 raft_consensus.cc:348] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.932883 6007 raft_consensus.cc:729] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:30.933041 6007 consensus_queue.cc:260] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:30.933581 6007 ts_tablet_manager.cc:1398] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 14:02:30.934301 5418 tablet_copy_service.cc:342] P 0b5d87b866b04909a7d8d16ea5b25483: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-3e89240009304303a397175ca656c512 received from {username='slave'} at 127.0.0.1:45168
I20240501 14:02:30.934405 5418 tablet_copy_service.cc:433] P 0b5d87b866b04909a7d8d16ea5b25483: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-3e89240009304303a397175ca656c512 on tablet 3e89240009304303a397175ca656c512 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:31.055022 6007 ts_tablet_manager.cc:902] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
I20240501 14:02:31.068986 6007 tablet_copy_client.cc:308] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.129:34507
I20240501 14:02:31.069710 5269 tablet_copy_service.cc:140] P bc68bd81bd5144d9bbcde254c8963fdc: Received BeginTabletCopySession request for tablet 7286a556f2ac4573a52b45a29f4352c6 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:60508)
I20240501 14:02:31.069852 5269 tablet_copy_service.cc:161] P bc68bd81bd5144d9bbcde254c8963fdc: Beginning new tablet copy session on tablet 7286a556f2ac4573a52b45a29f4352c6 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:60508: session id = b111fc283a294f5cbc564d60d2b45f93-7286a556f2ac4573a52b45a29f4352c6
I20240501 14:02:31.072103 5269 tablet_copy_source_session.cc:205] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:31.073340 6007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7286a556f2ac4573a52b45a29f4352c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:31.077904 6007 tablet_copy_client.cc:783] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:31.078140 6007 tablet_copy_client.cc:647] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:31.079941 6007 tablet_copy_client.cc:523] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:31.083428 6007 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:31.089690 6007 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:31.090082 6007 tablet_bootstrap.cc:492] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:31.090340 6007 ts_tablet_manager.cc:1367] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.002s
I20240501 14:02:31.090961 6007 raft_consensus.cc:348] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:31.091199 6007 raft_consensus.cc:729] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:31.091382 6007 consensus_queue.cc:260] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:31.091929 6007 ts_tablet_manager.cc:1398] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 14:02:31.092612 5269 tablet_copy_service.cc:342] P bc68bd81bd5144d9bbcde254c8963fdc: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-7286a556f2ac4573a52b45a29f4352c6 received from {username='slave'} at 127.0.0.1:60508
I20240501 14:02:31.092757 5269 tablet_copy_service.cc:433] P bc68bd81bd5144d9bbcde254c8963fdc: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-7286a556f2ac4573a52b45a29f4352c6 on tablet 7286a556f2ac4573a52b45a29f4352c6 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:31.253895 5877 raft_consensus.cc:1203] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:31.282868 5877 raft_consensus.cc:1203] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:31.319993 5877 raft_consensus.cc:1203] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:31.666311 5877 raft_consensus.cc:1203] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:31.761513 5999 raft_consensus.cc:1050] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:31.762230 5999 consensus_queue.cc:237] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.764386 5332 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.764461 5877 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.764847 5254 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.764851 6031 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.765269 5986 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.765578 5999 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.769383 6031 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.770182 5877 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.771837 5255 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.773584 5332 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.775324 5157 catalog_manager.cc:5484] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.789824 6030 raft_consensus.cc:1050] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:31.790531 6030 consensus_queue.cc:237] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.794095 5877 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.794122 5334 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.794879 5407 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.795038 6003 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.795464 5406 consensus_queue.cc:237] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.795619 6030 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.797142 6030 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.797586 5876 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.797960 5255 raft_consensus.cc:1261] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.798173 6036 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.798985 6036 consensus_queue.cc:1035] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.800261 5999 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.804342 5142 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3e89240009304303a397175ca656c512 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:31.805789 5876 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.805789 5255 raft_consensus.cc:2932] T 3e89240009304303a397175ca656c512 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.813217 5156 catalog_manager.cc:5484] T 3e89240009304303a397175ca656c512 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:31.815759 6042 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.817397 5322 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e89240009304303a397175ca656c512 with delete_type TABLET_DATA_TOMBSTONED (TS 1f109496867240cab78f9407ecbacf73 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59158
I20240501 14:02:31.816457 5877 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.819788 5406 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.823627 5154 catalog_manager.cc:5484] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.830832 5334 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.835848 6046 tablet_replica.cc:330] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: stopping tablet replica
I20240501 14:02:31.836123 6046 raft_consensus.cc:2229] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:31.836477 6046 raft_consensus.cc:2258] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:31.837515 6046 ts_tablet_manager.cc:1875] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:31.841188 5255 consensus_queue.cc:237] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.843699 5877 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.844837 5406 raft_consensus.cc:1261] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.845392 6036 raft_consensus.cc:1050] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:31.845551 6047 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.846001 6046 ts_tablet_manager.cc:1888] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:31.846086 6046 log.cc:1196] T 3e89240009304303a397175ca656c512 P 1f109496867240cab78f9407ecbacf73: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/wals/3e89240009304303a397175ca656c512
I20240501 14:02:31.846249 6036 consensus_queue.cc:237] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.846719 5143 catalog_manager.cc:4830] TS 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): tablet 3e89240009304303a397175ca656c512 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:31.848729 5876 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.849380 5999 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.849802 5255 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.850374 5999 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.852020 5334 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:31.852021 6047 consensus_queue.cc:1035] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.852571 5999 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:31.853863 6003 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.854949 5876 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.861007 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ca91b0a4dc4a4221ab6f7e6167ade06f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:31.861872 5406 raft_consensus.cc:2932] T ca91b0a4dc4a4221ab6f7e6167ade06f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.864768 6036 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.861940 5154 catalog_manager.cc:5484] T ca91b0a4dc4a4221ab6f7e6167ade06f P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.865319 5332 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.870628 5322 tablet_service.cc:1514] Processing DeleteTablet for tablet ca91b0a4dc4a4221ab6f7e6167ade06f with delete_type TABLET_DATA_TOMBSTONED (TS 1f109496867240cab78f9407ecbacf73 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59158
I20240501 14:02:31.873934 5155 catalog_manager.cc:5484] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:31.876248 6046 tablet_replica.cc:330] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: stopping tablet replica
I20240501 14:02:31.876468 6046 raft_consensus.cc:2229] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:31.876717 6046 raft_consensus.cc:2258] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:31.877233 5876 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.877786 6046 ts_tablet_manager.cc:1875] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:31.879305 5255 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.879807 5407 consensus_queue.cc:237] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:31.884045 5334 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.884606 5999 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.885784 5876 raft_consensus.cc:1261] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:31.886204 5999 consensus_queue.cc:1035] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:31.887228 6036 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.887836 5334 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.889881 5876 raft_consensus.cc:2932] T 1d14a452a4e14cfb9173b5d4e184ff6f P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:31.891420 5142 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1d14a452a4e14cfb9173b5d4e184ff6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:31.893193 6046 ts_tablet_manager.cc:1888] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:31.893316 6046 log.cc:1196] T ca91b0a4dc4a4221ab6f7e6167ade06f P 1f109496867240cab78f9407ecbacf73: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/wals/ca91b0a4dc4a4221ab6f7e6167ade06f
I20240501 14:02:31.894420 5154 catalog_manager.cc:5484] T 1d14a452a4e14cfb9173b5d4e184ff6f P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:31.897408 5143 catalog_manager.cc:4830] TS 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): tablet ca91b0a4dc4a4221ab6f7e6167ade06f (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:31.898727 5243 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d14a452a4e14cfb9173b5d4e184ff6f with delete_type TABLET_DATA_TOMBSTONED (TS bc68bd81bd5144d9bbcde254c8963fdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60472
I20240501 14:02:31.899380 6052 tablet_replica.cc:330] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: stopping tablet replica
I20240501 14:02:31.900260 6052 raft_consensus.cc:2229] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:31.900718 6052 raft_consensus.cc:2258] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:31.901485 6052 ts_tablet_manager.cc:1875] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:31.907771 6052 ts_tablet_manager.cc:1888] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:31.907917 6052 log.cc:1196] T 1d14a452a4e14cfb9173b5d4e184ff6f P bc68bd81bd5144d9bbcde254c8963fdc: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/wals/1d14a452a4e14cfb9173b5d4e184ff6f
I20240501 14:02:31.908628 5143 catalog_manager.cc:4830] TS bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): tablet 1d14a452a4e14cfb9173b5d4e184ff6f (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:32.059336 6047 raft_consensus.cc:1050] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:32.060135 6047 consensus_queue.cc:237] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:32.062436 5406 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:32.062683 5332 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:32.062697 5876 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:32.063196 6030 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:32.063493 6042 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:32.063758 6047 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:32.068495 6047 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.069380 5332 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.073494 5406 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.077468 5156 catalog_manager.cc:5484] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:32.078837 5876 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.087193 5254 consensus_queue.cc:237] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:32.089016 5876 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:32.089016 5332 raft_consensus.cc:1261] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:32.089556 6003 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:32.089926 6047 consensus_queue.cc:1035] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:32.092257 6030 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.092793 5332 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.092882 5876 raft_consensus.cc:2932] T 7286a556f2ac4573a52b45a29f4352c6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:32.095368 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7286a556f2ac4573a52b45a29f4352c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:32.097756 5155 catalog_manager.cc:5484] T 7286a556f2ac4573a52b45a29f4352c6 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:32.101940 5398 tablet_service.cc:1514] Processing DeleteTablet for tablet 7286a556f2ac4573a52b45a29f4352c6 with delete_type TABLET_DATA_TOMBSTONED (TS 0b5d87b866b04909a7d8d16ea5b25483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37984
I20240501 14:02:32.102883 6057 tablet_replica.cc:330] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: stopping tablet replica
I20240501 14:02:32.103085 6057 raft_consensus.cc:2229] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:32.103356 6057 raft_consensus.cc:2258] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:32.104138 6057 ts_tablet_manager.cc:1875] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:32.109215 6057 ts_tablet_manager.cc:1888] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:32.109329 6057 log.cc:1196] T 7286a556f2ac4573a52b45a29f4352c6 P 0b5d87b866b04909a7d8d16ea5b25483: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/wals/7286a556f2ac4573a52b45a29f4352c6
I20240501 14:02:32.109964 5142 catalog_manager.cc:4830] TS 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): tablet 7286a556f2ac4573a52b45a29f4352c6 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:33.117314 5406 consensus_queue.cc:237] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.119976 5334 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.119976 5255 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 14:02:33.120237 5373 consensus_peers.cc:485] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a26da6c9b322432f934b1de3669f0646. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:33.120666 6061 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.120993 5999 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.123852 6061 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.128041 5254 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.128123 5334 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.129813 5332 consensus_queue.cc:237] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.132639 5154 catalog_manager.cc:5484] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240501 14:02:33.141664 5299 consensus_peers.cc:485] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccc815b1d356477ab81ea553e21f208a. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:33.141824 5406 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.141960 5254 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.142446 5991 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.143030 5991 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.145859 5991 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.147786 5406 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.148445 5254 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.151654 5407 consensus_queue.cc:237] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.153434 5155 catalog_manager.cc:5484] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240501 14:02:33.156297 5373 consensus_peers.cc:485] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37d5b2fbe1f043e3923e2012d65c2c09. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:33.156592 5332 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.157078 6061 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.157650 5254 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.158078 6061 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.162074 5986 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.164865 5254 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.165503 5332 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.168605 5406 consensus_queue.cc:237] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.170583 5156 catalog_manager.cc:5484] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:33.174580 5254 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 14:02:33.174573 5373 consensus_peers.cc:485] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: caf4e76b1ea74fe3a460dfb8fb802df6. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:33.175287 5332 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:33.175745 5999 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.176038 6061 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:33.178733 6061 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.179494 5254 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.181035 5332 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.185883 5155 catalog_manager.cc:5484] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:33.522657 6078 ts_tablet_manager.cc:902] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:33.524446 6078 tablet_copy_client.cc:308] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.131:35465
I20240501 14:02:33.525084 5418 tablet_copy_service.cc:140] P 0b5d87b866b04909a7d8d16ea5b25483: Received BeginTabletCopySession request for tablet a26da6c9b322432f934b1de3669f0646 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:45168)
I20240501 14:02:33.525198 5418 tablet_copy_service.cc:161] P 0b5d87b866b04909a7d8d16ea5b25483: Beginning new tablet copy session on tablet a26da6c9b322432f934b1de3669f0646 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:45168: session id = b111fc283a294f5cbc564d60d2b45f93-a26da6c9b322432f934b1de3669f0646
I20240501 14:02:33.527120 5418 tablet_copy_source_session.cc:205] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:33.528074 6078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26da6c9b322432f934b1de3669f0646. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:33.533067 6078 tablet_copy_client.cc:783] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:33.533310 6078 tablet_copy_client.cc:647] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:33.534737 6078 tablet_copy_client.cc:523] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:33.537592 6078 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:33.542480 6078 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:33.542860 6078 tablet_bootstrap.cc:492] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:33.543118 6078 ts_tablet_manager.cc:1367] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 14:02:33.543678 6078 raft_consensus.cc:348] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.543926 6078 raft_consensus.cc:729] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:33.544124 6078 consensus_queue.cc:260] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.544957 6078 ts_tablet_manager.cc:1398] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:33.545753 5418 tablet_copy_service.cc:342] P 0b5d87b866b04909a7d8d16ea5b25483: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-a26da6c9b322432f934b1de3669f0646 received from {username='slave'} at 127.0.0.1:45168
I20240501 14:02:33.545858 5418 tablet_copy_service.cc:433] P 0b5d87b866b04909a7d8d16ea5b25483: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-a26da6c9b322432f934b1de3669f0646 on tablet a26da6c9b322432f934b1de3669f0646 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:33.690861 6078 ts_tablet_manager.cc:902] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:33.692198 6078 tablet_copy_client.cc:308] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.131:35465
I20240501 14:02:33.692888 5418 tablet_copy_service.cc:140] P 0b5d87b866b04909a7d8d16ea5b25483: Received BeginTabletCopySession request for tablet caf4e76b1ea74fe3a460dfb8fb802df6 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:45168)
I20240501 14:02:33.693060 5418 tablet_copy_service.cc:161] P 0b5d87b866b04909a7d8d16ea5b25483: Beginning new tablet copy session on tablet caf4e76b1ea74fe3a460dfb8fb802df6 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:45168: session id = b111fc283a294f5cbc564d60d2b45f93-caf4e76b1ea74fe3a460dfb8fb802df6
I20240501 14:02:33.695533 5418 tablet_copy_source_session.cc:205] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:33.696816 6078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4e76b1ea74fe3a460dfb8fb802df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:33.703017 6078 tablet_copy_client.cc:783] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:33.703254 6078 tablet_copy_client.cc:647] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:33.704704 6078 tablet_copy_client.cc:523] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:33.707486 6078 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:33.712881 6078 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:33.713176 6078 tablet_bootstrap.cc:492] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:33.713378 6078 ts_tablet_manager.cc:1367] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.001s
I20240501 14:02:33.713971 6078 raft_consensus.cc:348] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.714213 6078 raft_consensus.cc:729] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:33.714428 6078 consensus_queue.cc:260] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.715108 6078 ts_tablet_manager.cc:1398] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 14:02:33.715699 5418 tablet_copy_service.cc:342] P 0b5d87b866b04909a7d8d16ea5b25483: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-caf4e76b1ea74fe3a460dfb8fb802df6 received from {username='slave'} at 127.0.0.1:45168
I20240501 14:02:33.715806 5418 tablet_copy_service.cc:433] P 0b5d87b866b04909a7d8d16ea5b25483: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-caf4e76b1ea74fe3a460dfb8fb802df6 on tablet caf4e76b1ea74fe3a460dfb8fb802df6 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:33.751633 6078 ts_tablet_manager.cc:902] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465)
I20240501 14:02:33.756462 6093 ts_tablet_manager.cc:902] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859)
I20240501 14:02:33.764020 6078 tablet_copy_client.cc:308] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.131:35465
I20240501 14:02:33.765288 5418 tablet_copy_service.cc:140] P 0b5d87b866b04909a7d8d16ea5b25483: Received BeginTabletCopySession request for tablet 37d5b2fbe1f043e3923e2012d65c2c09 from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:45168)
I20240501 14:02:33.765436 5418 tablet_copy_service.cc:161] P 0b5d87b866b04909a7d8d16ea5b25483: Beginning new tablet copy session on tablet 37d5b2fbe1f043e3923e2012d65c2c09 from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:45168: session id = b111fc283a294f5cbc564d60d2b45f93-37d5b2fbe1f043e3923e2012d65c2c09
I20240501 14:02:33.765677 6093 tablet_copy_client.cc:308] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Beginning tablet copy session from remote peer at address 127.4.14.130:41859
I20240501 14:02:33.767855 5418 tablet_copy_source_session.cc:205] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:33.768467 5344 tablet_copy_service.cc:140] P 1f109496867240cab78f9407ecbacf73: Received BeginTabletCopySession request for tablet ccc815b1d356477ab81ea553e21f208a from peer b111fc283a294f5cbc564d60d2b45f93 ({username='slave'} at 127.0.0.1:59182)
I20240501 14:02:33.768608 5344 tablet_copy_service.cc:161] P 1f109496867240cab78f9407ecbacf73: Beginning new tablet copy session on tablet ccc815b1d356477ab81ea553e21f208a from peer b111fc283a294f5cbc564d60d2b45f93 at {username='slave'} at 127.0.0.1:59182: session id = b111fc283a294f5cbc564d60d2b45f93-ccc815b1d356477ab81ea553e21f208a
I20240501 14:02:33.769109 6078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d5b2fbe1f043e3923e2012d65c2c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:33.771225 5344 tablet_copy_source_session.cc:205] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:02:33.772367 6093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccc815b1d356477ab81ea553e21f208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:02:33.776082 6078 tablet_copy_client.cc:783] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:33.776309 6078 tablet_copy_client.cc:647] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:33.777944 6078 tablet_copy_client.cc:523] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:33.778744 6093 tablet_copy_client.cc:783] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 0 data blocks...
I20240501 14:02:33.778919 6093 tablet_copy_client.cc:647] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Starting download of 1 WAL segments...
I20240501 14:02:33.780712 6093 tablet_copy_client.cc:523] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:02:33.781262 6078 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:33.784126 6093 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Bootstrap starting.
I20240501 14:02:33.786727 6078 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:33.787089 6078 tablet_bootstrap.cc:492] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:33.787302 6078 ts_tablet_manager.cc:1367] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240501 14:02:33.788087 6078 raft_consensus.cc:348] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.788321 6078 raft_consensus.cc:729] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:33.788497 6078 consensus_queue.cc:260] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.789265 6078 ts_tablet_manager.cc:1398] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240501 14:02:33.789893 5418 tablet_copy_service.cc:342] P 0b5d87b866b04909a7d8d16ea5b25483: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-37d5b2fbe1f043e3923e2012d65c2c09 received from {username='slave'} at 127.0.0.1:45168
I20240501 14:02:33.790001 5418 tablet_copy_service.cc:433] P 0b5d87b866b04909a7d8d16ea5b25483: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-37d5b2fbe1f043e3923e2012d65c2c09 on tablet 37d5b2fbe1f043e3923e2012d65c2c09 with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:33.790647 6093 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:02:33.791016 6093 tablet_bootstrap.cc:492] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Bootstrap complete.
I20240501 14:02:33.791744 6093 ts_tablet_manager.cc:1367] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20240501 14:02:33.792449 6093 raft_consensus.cc:348] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.792621 6093 raft_consensus.cc:729] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b111fc283a294f5cbc564d60d2b45f93, State: Initialized, Role: LEARNER
I20240501 14:02:33.792742 6093 consensus_queue.cc:260] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:33.793270 6093 ts_tablet_manager.cc:1398] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 14:02:33.793908 5344 tablet_copy_service.cc:342] P 1f109496867240cab78f9407ecbacf73: Request end of tablet copy session b111fc283a294f5cbc564d60d2b45f93-ccc815b1d356477ab81ea553e21f208a received from {username='slave'} at 127.0.0.1:59182
I20240501 14:02:33.793996 5344 tablet_copy_service.cc:433] P 1f109496867240cab78f9407ecbacf73: ending tablet copy session b111fc283a294f5cbc564d60d2b45f93-ccc815b1d356477ab81ea553e21f208a on tablet ccc815b1d356477ab81ea553e21f208a with peer b111fc283a294f5cbc564d60d2b45f93
I20240501 14:02:34.107568 5876 raft_consensus.cc:1203] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:34.223897 5876 raft_consensus.cc:1203] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:34.227208 5876 raft_consensus.cc:1203] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:34.314250 5876 raft_consensus.cc:1203] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 14:02:34.558840 6077 raft_consensus.cc:1050] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:34.559602 6077 consensus_queue.cc:237] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.565436 5876 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.566032 6102 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.566294 5255 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.566812 5332 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.567080 6102 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.568048 6102 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.570534 5999 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.573993 5255 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.577791 5876 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.578038 5334 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.581174 5155 catalog_manager.cc:5484] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.591406 5406 consensus_queue.cc:237] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.593308 5334 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.593308 5876 raft_consensus.cc:1261] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.593851 5999 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.594300 6102 consensus_queue.cc:1035] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.596540 5999 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.597287 5332 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.597316 5876 raft_consensus.cc:2932] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.602749 5142 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a26da6c9b322432f934b1de3669f0646 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:34.603232 5154 catalog_manager.cc:5484] T a26da6c9b322432f934b1de3669f0646 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.606607 5243 tablet_service.cc:1514] Processing DeleteTablet for tablet a26da6c9b322432f934b1de3669f0646 with delete_type TABLET_DATA_TOMBSTONED (TS bc68bd81bd5144d9bbcde254c8963fdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60472
I20240501 14:02:34.607239 6115 tablet_replica.cc:330] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: stopping tablet replica
I20240501 14:02:34.607450 6115 raft_consensus.cc:2229] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:34.607786 6115 raft_consensus.cc:2258] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:34.608603 6115 ts_tablet_manager.cc:1875] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:34.614806 6115 ts_tablet_manager.cc:1888] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:34.614938 6115 log.cc:1196] T a26da6c9b322432f934b1de3669f0646 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/wals/a26da6c9b322432f934b1de3669f0646
I20240501 14:02:34.615679 5143 catalog_manager.cc:4830] TS bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): tablet a26da6c9b322432f934b1de3669f0646 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:34.746999 6114 raft_consensus.cc:1050] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:34.747658 6114 consensus_queue.cc:237] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.749897 5254 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.750022 5332 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.750022 5876 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.750406 6077 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.750699 6109 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.750978 6114 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.755208 6077 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.755851 5332 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.760267 5876 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.761801 5155 catalog_manager.cc:5484] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 14:02:34.764461 5254 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.771098 5407 consensus_queue.cc:237] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.773468 5254 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.773526 5876 raft_consensus.cc:1261] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.774130 6114 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.774551 6077 consensus_queue.cc:1035] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.776612 6109 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.777350 5877 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.780386 5142 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 37d5b2fbe1f043e3923e2012d65c2c09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:34.781241 5254 raft_consensus.cc:2932] T 37d5b2fbe1f043e3923e2012d65c2c09 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.781802 5155 catalog_manager.cc:5484] T 37d5b2fbe1f043e3923e2012d65c2c09 P b111fc283a294f5cbc564d60d2b45f93 reported cstate change: config changed from index 3 to 4, VOTER 1f109496867240cab78f9407ecbacf73 (127.4.14.130) evicted. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.785931 5322 tablet_service.cc:1514] Processing DeleteTablet for tablet 37d5b2fbe1f043e3923e2012d65c2c09 with delete_type TABLET_DATA_TOMBSTONED (TS 1f109496867240cab78f9407ecbacf73 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59158
I20240501 14:02:34.788930 6121 tablet_replica.cc:330] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: stopping tablet replica
I20240501 14:02:34.789173 6121 raft_consensus.cc:2229] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:34.789469 6121 raft_consensus.cc:2258] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:34.790614 6121 ts_tablet_manager.cc:1875] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:34.795717 6121 ts_tablet_manager.cc:1888] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:34.795854 6121 log.cc:1196] T 37d5b2fbe1f043e3923e2012d65c2c09 P 1f109496867240cab78f9407ecbacf73: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-1-root/wals/37d5b2fbe1f043e3923e2012d65c2c09
I20240501 14:02:34.796561 5143 catalog_manager.cc:4830] TS 1f109496867240cab78f9407ecbacf73 (127.4.14.130:41859): tablet 37d5b2fbe1f043e3923e2012d65c2c09 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:34.798921 6109 raft_consensus.cc:1050] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:34.799652 6109 consensus_queue.cc:237] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.802275 5334 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.802268 5877 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.802268 5254 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.803071 6109 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.803431 6102 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.803715 6077 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.805972 6120 raft_consensus.cc:1050] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73: attempting to promote NON_VOTER b111fc283a294f5cbc564d60d2b45f93 to VOTER
I20240501 14:02:34.806648 6120 consensus_queue.cc:237] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.809473 5877 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 LEARNER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.809485 5406 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.810405 5254 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 14:02:34.810810 6101 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.811048 6120 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.811506 6127 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 14:02:34.829476 6077 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.833070 5330 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.842413 5255 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.842597 5156 catalog_manager.cc:5484] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:34.844493 5876 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.850733 6120 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.851768 5254 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.851939 5877 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.855511 5407 consensus_queue.cc:237] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.856468 5406 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.858083 5155 catalog_manager.cc:5484] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 2 to 3, b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.858824 5332 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.859601 6102 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.860251 5876 raft_consensus.cc:1261] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.860721 6102 consensus_queue.cc:1035] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.863709 6102 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.865250 5330 consensus_queue.cc:237] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } }
I20240501 14:02:34.867542 5254 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.868094 6120 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.868360 5876 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.870242 5332 raft_consensus.cc:2932] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.872545 5877 raft_consensus.cc:1261] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 14:02:34.873416 6120 consensus_queue.cc:1035] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 14:02:34.872766 5142 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet caf4e76b1ea74fe3a460dfb8fb802df6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:34.876224 6101 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.876956 5254 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.878096 5154 catalog_manager.cc:5484] T caf4e76b1ea74fe3a460dfb8fb802df6 P 1f109496867240cab78f9407ecbacf73 reported cstate change: config changed from index 3 to 4, VOTER bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129) evicted. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.879995 5143 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ccc815b1d356477ab81ea553e21f208a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 14:02:34.881496 5875 raft_consensus.cc:2932] T ccc815b1d356477ab81ea553e21f208a P b111fc283a294f5cbc564d60d2b45f93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.882546 5156 catalog_manager.cc:5484] T ccc815b1d356477ab81ea553e21f208a P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index 3 to 4, VOTER 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131) evicted. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: false } } }
I20240501 14:02:34.885875 5243 tablet_service.cc:1514] Processing DeleteTablet for tablet caf4e76b1ea74fe3a460dfb8fb802df6 with delete_type TABLET_DATA_TOMBSTONED (TS bc68bd81bd5144d9bbcde254c8963fdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60472
I20240501 14:02:34.886195 6115 tablet_replica.cc:330] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: stopping tablet replica
I20240501 14:02:34.886399 6115 raft_consensus.cc:2229] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:34.886615 6115 raft_consensus.cc:2258] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:34.886932 5398 tablet_service.cc:1514] Processing DeleteTablet for tablet ccc815b1d356477ab81ea553e21f208a with delete_type TABLET_DATA_TOMBSTONED (TS 0b5d87b866b04909a7d8d16ea5b25483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37984
I20240501 14:02:34.887758 6115 ts_tablet_manager.cc:1875] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:34.891510 6132 tablet_replica.cc:330] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: stopping tablet replica
I20240501 14:02:34.891809 6132 raft_consensus.cc:2229] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 14:02:34.892246 6132 raft_consensus.cc:2258] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 14:02:34.893172 6132 ts_tablet_manager.cc:1875] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:02:34.896390 6115 ts_tablet_manager.cc:1888] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:34.896514 6115 log.cc:1196] T caf4e76b1ea74fe3a460dfb8fb802df6 P bc68bd81bd5144d9bbcde254c8963fdc: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-0-root/wals/caf4e76b1ea74fe3a460dfb8fb802df6
I20240501 14:02:34.897224 5143 catalog_manager.cc:4830] TS bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507): tablet caf4e76b1ea74fe3a460dfb8fb802df6 (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:34.898901 6132 ts_tablet_manager.cc:1888] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 14:02:34.899010 6132 log.cc:1196] T ccc815b1d356477ab81ea553e21f208a P 0b5d87b866b04909a7d8d16ea5b25483: Deleting WAL directory at /tmp/dist-test-taskWwCk8W/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714572087283996-4154-0/minicluster-data/ts-2-root/wals/ccc815b1d356477ab81ea553e21f208a
I20240501 14:02:34.899770 5142 catalog_manager.cc:4830] TS 0b5d87b866b04909a7d8d16ea5b25483 (127.4.14.131:35465): tablet ccc815b1d356477ab81ea553e21f208a (table test-workload [id=f98dbc4f29f94d9488aa4dc1e00937ef]) successfully deleted
I20240501 14:02:35.905966 5255 consensus_queue.cc:237] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:35.908210 5330 raft_consensus.cc:1261] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.908607 5407 raft_consensus.cc:1261] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 14:02:35.908648 5224 consensus_peers.cc:485] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1ba525391dc4e00bdbc841f4eeead11. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:35.909058 6133 consensus_queue.cc:1035] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.909324 6135 consensus_queue.cc:1035] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.911692 6059 raft_consensus.cc:2932] T b1ba525391dc4e00bdbc841f4eeead11 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.912464 5407 raft_consensus.cc:2932] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.912396 5330 raft_consensus.cc:2932] T b1ba525391dc4e00bdbc841f4eeead11 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.917239 5406 consensus_queue.cc:237] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:35.917385 5156 catalog_manager.cc:5484] T b1ba525391dc4e00bdbc841f4eeead11 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } attrs { replace: true } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
W20240501 14:02:35.928233 5373 consensus_peers.cc:485] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a564d8cf00624da7a2cfc98cf6740d84. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:35.928537 5330 raft_consensus.cc:1261] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.929134 6077 consensus_queue.cc:1035] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.937376 5255 raft_consensus.cc:1261] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 0b5d87b866b04909a7d8d16ea5b25483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.939013 6077 consensus_queue.cc:1035] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.938918 6102 raft_consensus.cc:2932] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.940330 5330 raft_consensus.cc:2932] T a564d8cf00624da7a2cfc98cf6740d84 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.942143 5255 raft_consensus.cc:2932] T a564d8cf00624da7a2cfc98cf6740d84 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.944566 5259 consensus_queue.cc:237] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:35.947190 5157 catalog_manager.cc:5484] T a564d8cf00624da7a2cfc98cf6740d84 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "0b5d87b866b04909a7d8d16ea5b25483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240501 14:02:35.953007 5224 consensus_peers.cc:485] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c92911631b1342ba9e020fd73c191980. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:35.953030 5406 raft_consensus.cc:1261] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.953029 5330 raft_consensus.cc:1261] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Refusing update from remote peer bc68bd81bd5144d9bbcde254c8963fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.953481 6140 consensus_queue.cc:1035] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.953778 6133 consensus_queue.cc:1035] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.956163 6135 raft_consensus.cc:2932] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.956645 5406 raft_consensus.cc:2932] T c92911631b1342ba9e020fd73c191980 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.960556 5332 raft_consensus.cc:2932] T c92911631b1342ba9e020fd73c191980 P 1f109496867240cab78f9407ecbacf73 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.961385 5330 consensus_queue.cc:237] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } }
I20240501 14:02:35.962533 5154 catalog_manager.cc:5484] T c92911631b1342ba9e020fd73c191980 P bc68bd81bd5144d9bbcde254c8963fdc reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 14:02:35.965101 5406 raft_consensus.cc:1261] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.965238 5259 raft_consensus.cc:1261] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Refusing update from remote peer 1f109496867240cab78f9407ecbacf73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 14:02:35.966100 6120 consensus_queue.cc:1035] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 14:02:35.966986 5299 consensus_peers.cc:485] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 -> Peer b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132:44613): Couldn't send request to peer b111fc283a294f5cbc564d60d2b45f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5e6f81c0344dd98ed536563b784bf5. This is attempt 1: this message will repeat every 5th retry.
I20240501 14:02:35.968196 6120 consensus_queue.cc:1035] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 14:02:35.970631 6131 raft_consensus.cc:2932] T 3c5e6f81c0344dd98ed536563b784bf5 P 1f109496867240cab78f9407ecbacf73 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.971280 5406 raft_consensus.cc:2932] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.974342 5259 raft_consensus.cc:2932] T 3c5e6f81c0344dd98ed536563b784bf5 P bc68bd81bd5144d9bbcde254c8963fdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:35.977356 5157 catalog_manager.cc:5484] T 3c5e6f81c0344dd98ed536563b784bf5 P 0b5d87b866b04909a7d8d16ea5b25483 reported cstate change: config changed from index -1 to 2, NON_VOTER b111fc283a294f5cbc564d60d2b45f93 (127.4.14.132) added. New cstate: current_term: 1 leader_uuid: "1f109496867240cab78f9407ecbacf73" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc68bd81bd5144d9bbcde254c8963fdc" member_type: VOTER last_known_addr { host: "127.4.14.129" port: 34507 } attrs { replace: true } } peers { permanent_uuid: "1f109496867240cab78f9407ecbacf73" member_type: VOTER last_known_addr { host: "127.4.14.130" port: 41859 } } peers { permanent_uuid: "0b5d87b866b04909a7d8d16ea5b25483" member_type: VOTER last_known_addr { host: "127.4.14.131" port: 35465 } } peers { permanent_uuid: "b111fc283a294f5cbc564d60d2b45f93" member_type: NON_VOTER last_known_addr { host: "127.4.14.132" port: 44613 } attrs { promote: true } } }
I20240501 14:02:36.298262 6156 ts_tablet_manager.cc:902] T b1ba525391dc4e00bdbc841f4eeead11 P b111fc283a294f5cbc564d60d2b45f93: Initiating tablet copy from peer bc68bd81bd5144d9bbcde254c8963fdc (127.4.14.129:34507)
F20240501 14:02:36.299150 6156 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.queue_time_us, tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.queue_time_us) (tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.run_cpu_time_us, tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.run_cpu_time_us) (tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.run_wall_time_us, tablet-download-pool-07d904a12cde4e98a7f409f7f0868eae.run_wall_time_us) (tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.queue_time_us, tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.queue_time_us) (tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.run_cpu_time_us, tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.run_cpu_time_us) (tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.run_wall_time_us, tablet-download-pool-1d14a452a4e14cfb9173b5d4e184ff6f.run_wall_time_us) (tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.queue_time_us, tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.queue_time_us) (tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.run_cpu_time_us, tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.run_cpu_time_us) (tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.run_wall_time_us, tablet-download-pool-32aa0719fcbe4ce2af3113452bb72901.run_wall_time_us) (tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.queue_time_us, tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.queue_time_us) (tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.run_cpu_time_us, tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.run_cpu_time_us) (tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.run_wall_time_us, tablet-download-pool-37d5b2fbe1f043e3923e2012d65c2c09.run_wall_time_us) (tablet-download-pool-3e89240009304303a397175ca656c512.queue_time_us, tablet-download-pool-3e89240009304303a397175ca656c512.queue_time_us) (tablet-download-pool-3e89240009304303a397175ca656c512.run_cpu_time_us, tablet-download-pool-3e89240009304303a397175ca656c512.run_cpu_time_us) (tablet-download-pool-3e89240009304303a397175ca656c512.run_wall_time_us, tablet-download-pool-3e89240009304303a397175ca656c512.run_wall_time_us) (tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.queue_time_us, tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.queue_time_us) (tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.run_cpu_time_us, tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.run_cpu_time_us) (tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.run_wall_time_us, tablet-download-pool-7286a556f2ac4573a52b45a29f4352c6.run_wall_time_us) (tablet-download-pool-a26da6c9b322432f934b1de3669f0646.queue_time_us, tablet-download-pool-a26da6c9b322432f934b1de3669f0646.queue_time_us) (tablet-download-pool-a26da6c9b322432f934b1de3669f0646.run_cpu_time_us, tablet-download-pool-a26da6c9b322432f934b1de3669f0646.run_cpu_time_us) (tablet-download-pool-a26da6c9b322432f934b1de3669f0646.run_wall_time_us, tablet-download-pool-a26da6c9b322432f934b1de3669f0646.run_wall_time_us) (tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.queue_time_us, tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.queue_time_us) (tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.run_cpu_time_us, tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.run_cpu_time_us) (tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.run_wall_time_us, tablet-download-pool-a7b0d70a8e37426e8e6f7d11501a1ed1.run_wall_time_us) (tablet-download-pool-b1ba525391dc4e00bdbc841f4eeead11.queue_time_us, tablet-download-pool-b1ba525391dc4e00bdbc841f4eeead11.queue_time_us) (tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.queue_time_us, tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.queue_time_us) (tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.run_cpu_time_us, tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.run_cpu_time_us) (tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.run_wall_time_us, tablet-download-pool-ca91b0a4dc4a4221ab6f7e6167ade06f.run_wall_time_us) (tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.queue_time_us, tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.queue_time_us) (tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.run_cpu_time_us, tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.run_cpu_time_us) (tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.run_wall_time_us, tablet-download-pool-caf4e76b1ea74fe3a460dfb8fb802df6.run_wall_time_us) (tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.queue_time_us, tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.queue_time_us) (tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.run_cpu_time_us, tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.run_cpu_time_us) (tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.run_wall_time_us, tablet-download-pool-ccc815b1d356477ab81ea553e21f208a.run_wall_time_us) (tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.queue_time_us, tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.queue_time_us) (tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.run_cpu_time_us, tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.run_cpu_time_us) (tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.run_wall_time_us, tablet-download-pool-d3709ce4d5d845d3863fe71b6b5a77a3.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714572156 (unix time) try "date -d @1714572156" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000103a) received by PID 4154 (TID 0x7f95bae79700) from PID 4154; stack trace: ***
@ 0x7f9670958980 (unknown) at ??:0
@ 0x7f9665ca5fb7 gsignal at ??:0
@ 0x7f9665ca7921 abort at ??:0
@ 0x7f966875adcd google::LogMessage::Fail() at ??:0
@ 0x7f966875eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f966875a7cc google::LogMessage::Flush() at ??:0
@ 0x7f966875bf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9669dd7742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f9669da3f8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f9669d9dcd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f96792698de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f9679281daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f96793ac480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f96793e4a8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f96793c7981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f96793c770e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f967e26998d std::function<>::operator()() at ??:0
@ 0x7f9669da7b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9669dab19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9669dab019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f967e26998d std::function<>::operator()() at ??:0
@ 0x7f9669d8601e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f967094d6db start_thread at ??:0
@ 0x7f9665d8871f clone at ??:0